-- Logs begin at Wed 2022-07-20 14:33:59 UTC, end at Wed 2022-07-20 15:54:16 UTC. -- Jul 20 15:22:25.045197 dv-cinder-819149-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 15:22:25.054221 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 15:22:25.056655 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 15:22:25 2022] *** Jul 20 15:22:25.056655 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 15:22:25.056655 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 15:22:25.056655 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: nodename: dv-cinder-819149-12-iscsi Jul 20 15:22:25.056655 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: machine: x86_64 Jul 20 15:22:25.056655 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: clock source: unix Jul 20 15:22:25.056655 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: pcre jit disabled Jul 20 15:22:25.056655 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: detected number of CPU cores: 4 Jul 20 15:22:25.056655 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: current working directory: / Jul 20 15:22:25.056655 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: detected binary path: /usr/bin/uwsgi-core Jul 20 15:22:25.057365 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: your processes number limit is 47680 Jul 20 15:22:25.057365 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: your memory page size is 4096 bytes Jul 20 15:22:25.057365 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: detected max file descriptor number: 2048 Jul 20 15:22:25.057365 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: lock engine: pthread robust mutexes Jul 20 15:22:25.057365 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: thunder lock: enabled Jul 20 15:22:25.057365 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 15:22:25.057365 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 15:22:25.099991 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: Python main interpreter initialized at 0x56430f8189c0 Jul 20 15:22:25.099991 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: python threads support enabled Jul 20 15:22:25.099991 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: your server socket listen backlog is limited to 100 connections Jul 20 15:22:25.099991 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: your mercy for graceful operations on workers is 90 seconds Jul 20 15:22:25.100352 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 15:22:25.100433 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: *** Operational MODE: preforking *** Jul 20 15:22:25.100676 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: *** uWSGI is running in multiple interpreter mode *** Jul 20 15:22:25.100676 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: spawned uWSGI master process (pid: 103759) Jul 20 15:22:25.100864 dv-cinder-819149-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 15:22:25.103172 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: spawned uWSGI worker 1 (pid: 103760, cores: 1) Jul 20 15:22:25.103172 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: spawned uWSGI worker 2 (pid: 103761, cores: 1) Jul 20 15:22:25.103172 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 15:22:25.757357 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 15:22:25.757963 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 15:22:26.872077 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 15:22:26.872077 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: from cryptography.utils import int_from_bytes Jul 20 15:22:26.872765 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 15:22:26.872765 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: from cryptography.utils import int_from_bytes Jul 20 15:22:26.872886 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 15:22:26.872886 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: from cryptography.utils import int_from_bytes Jul 20 15:22:26.873280 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 15:22:26.873280 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: from cryptography.utils import int_from_bytes Jul 20 15:22:29.323693 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 15:22:29.324358 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 15:22:29.324456 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 15:22:29.324808 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 15:22:29.325059 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 15:22:29.325201 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 15:22:29.325563 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.325652 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 15:22:29.325744 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.325964 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 15:22:29.326059 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.326341 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 15:22:29.326443 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.326598 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 15:22:29.326697 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.326989 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.327090 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.327305 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.327400 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.327621 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.327713 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.327932 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.328023 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.328189 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.328292 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.328502 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.328593 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.328822 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-12-iscsi {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.328914 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.329140 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.329233 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.329443 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.329539 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.329697 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.329788 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.330007 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.330108 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.330347 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-12-iscsi {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.330446 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.330664 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.330756 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.330966 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.331060 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.331267 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.331457 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.331852 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.331852 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.332100 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.332216 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.332350 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.332464 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.332580 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.332807 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.332949 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.333115 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.333347 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.333424 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.333534 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.333725 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.333820 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.334030 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.334123 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.334388 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.334487 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.334699 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.334786 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.335026 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.335124 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-12-iscsi {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.335330 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.335421 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.335647 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.335738 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.335952 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.336046 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.336347 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-12-iscsi {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.336442 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.336657 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.336755 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.336961 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.337802 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.337942 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.338267 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.338406 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.338597 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.338767 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.338922 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.339052 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.339242 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.339362 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.339559 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.339679 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.339877 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.339999 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.340178 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.340305 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.340484 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.340627 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.340790 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.340943 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.341104 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.341257 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.341409 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.341573 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.341712 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.341870 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.341964 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.342174 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.342303 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.342503 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.342628 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.342886 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.342984 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.343162 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.343261 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.343420 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.343586 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.343680 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.343767 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.343958 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.344047 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.344272 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.344370 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.344587 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.344673 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.344900 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.344997 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.345148 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.345241 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.345395 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.345490 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.345706 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.345798 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.346020 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.346113 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.346345 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.346449 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.346652 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.346750 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.346959 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.347051 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.347261 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.347359 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.347561 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.347657 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.347862 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.347948 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.348162 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.348255 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.348461 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.348555 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.348877 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.348979 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.349076 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.349167 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.349388 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.349491 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.349689 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.349775 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.350000 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.350091 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.350333 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.350430 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.350643 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.350728 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.350945 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.351033 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.351247 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.351334 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.351551 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.351637 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.351860 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.351953 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.352172 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.352259 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.352475 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.352567 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.352752 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.352843 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.353050 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.353143 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.353353 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.353453 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.353668 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.353766 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.353973 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.354059 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.354292 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.354391 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.354549 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.354647 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.354844 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.354936 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.355146 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.355237 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.355459 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.355556 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.355760 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.355850 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.356060 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.356151 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.356361 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.356459 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.356653 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.356737 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.356953 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.357043 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.357252 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.357348 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.357550 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.357640 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.357847 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.357937 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.358147 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.358234 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.358470 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.358602 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.358771 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.358865 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.359069 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.359155 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.359366 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.359526 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.359680 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.359771 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.359984 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.360076 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.360281 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.360366 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.360581 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.360936 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.361140 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.361228 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.361440 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.361525 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.361751 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.361880 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.362052 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.362144 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.362373 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.362461 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.362688 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.362783 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.362984 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.363077 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.363280 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.363367 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.363589 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.363672 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.363886 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.363972 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.364185 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.364270 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.364493 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.364594 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.364781 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.364867 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.365079 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.365172 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.365380 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.365479 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.365678 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.365763 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.365974 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.366064 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.366309 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.366414 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.366589 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.366674 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.366890 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.366981 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.367187 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.367281 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.367485 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.367579 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.367780 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.367879 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.368072 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.368167 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.368405 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.368490 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.368718 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.368803 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.369019 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.369105 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.369318 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.369404 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.369617 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.369703 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.369928 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:22:29.370015 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.370276 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.370364 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.370601 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.370694 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.370918 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.371004 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.371235 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.371328 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.371540 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.371638 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.371851 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.371983 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.372158 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.372243 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.372466 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.372563 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.372773 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.372859 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.373090 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.373181 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.373394 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.373491 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.373700 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.373810 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.374004 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.374091 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.374336 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.374437 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.374650 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.374734 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.374974 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.375058 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.375281 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.375377 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.375585 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.375670 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.375895 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.375980 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.376200 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.376305 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.376511 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.376604 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.376840 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.376926 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.377153 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.377247 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.377459 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.377543 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.377765 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.377851 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.378075 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.378161 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.378421 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.378509 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.378737 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.378821 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.379052 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.379144 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.379355 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.379439 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.379659 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.379745 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.379964 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.380164 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.380260 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.380342 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.380571 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.380766 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.380932 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.381013 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.381180 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.381266 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.381485 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.381579 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.381791 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.381878 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.382093 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.382179 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.382428 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.382529 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.382736 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.382829 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.383046 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.383140 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.383359 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.383456 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.383666 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.383763 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.384482 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.384573 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.384787 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.384881 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.385094 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.385178 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.385396 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.385479 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.385704 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.385796 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.386008 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.386099 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.386329 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.386418 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.386632 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.386732 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.386936 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.387023 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.387241 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.387327 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.387550 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.387642 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.387861 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.387957 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.388162 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.388246 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.388472 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.388557 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.388777 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.388902 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.389079 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.389173 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.389382 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.389473 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.389687 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.389781 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.389990 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.390086 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.390316 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.390404 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.390623 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.390708 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.390923 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.391019 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.391238 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.391325 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.391540 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.391640 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.391839 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.391937 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.392157 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.392250 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.392456 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.392549 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.392755 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.392842 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.393064 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.393150 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.393368 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.393455 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.393673 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.393760 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.393979 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.394065 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.394301 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.394391 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.394622 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.394710 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.394931 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.395024 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.395240 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.395326 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.395561 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.395646 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.395871 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.395963 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.396169 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.396261 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.396469 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.396561 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.396773 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.396858 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.397079 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.397173 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.397381 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.397474 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.397680 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.397765 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.397976 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.398073 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.398295 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.398395 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.398595 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.398681 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.398899 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.399043 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.399197 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.399283 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.399495 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.399617 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.400384 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.400487 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.400919 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.401001 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.401080 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.401159 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.401257 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.401351 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.401539 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.401632 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.401836 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.401926 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.402133 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.402221 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.402455 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.402565 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.402791 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.402877 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.403091 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.403178 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.403424 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.403520 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.403750 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.403847 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.404064 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.404158 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.404373 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.404458 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.404678 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.404780 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.404987 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.405073 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.405291 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.405382 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.405597 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.405697 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.405905 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.405991 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.406212 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.406349 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.406553 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.406648 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.406860 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.406945 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.407174 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.407265 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.407483 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.407583 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.407799 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.407893 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.408115 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.408209 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.408417 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.408503 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.408715 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.408800 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.409024 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.409157 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.409336 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.409422 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.409648 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.409739 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.409958 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.410044 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.410282 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.410372 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.410597 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.410690 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.410906 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.410990 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.411207 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.411300 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.411511 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.411597 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.411815 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.411910 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.412119 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.412214 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.412431 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.412516 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.412730 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.412823 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.413040 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.413124 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.413340 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.413431 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.413655 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.413754 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.413959 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.414045 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.414284 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.414385 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.414588 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.414683 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.414894 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.414987 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.415235 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.415320 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.415549 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.415644 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.415852 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.415937 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.416152 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.416243 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.416462 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.416550 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.416763 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.416855 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.417066 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.417152 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.417375 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.417461 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.417672 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.417757 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.417983 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.418073 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.418321 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.418424 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.418628 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.418714 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.418929 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.419015 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.419238 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.419325 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.419543 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.419629 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.419852 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.419949 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.420154 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.420240 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.420453 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.420538 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.420750 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.420843 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.421052 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.421137 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.421366 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.421459 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.421672 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.421765 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.421977 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.422063 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.422296 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.422384 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.422601 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.422701 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.422904 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.422990 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.423222 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.423307 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.423522 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.423608 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.423820 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.423905 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.424116 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.424202 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.424414 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.424502 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.424735 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.424820 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.425047 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.425132 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.425344 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.425438 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.425654 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.425740 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.425962 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.426054 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.426282 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.426371 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.426593 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.426680 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.426986 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.427149 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.427294 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.427416 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.427539 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.427678 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.427809 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.427905 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.428112 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.428201 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.428416 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.428509 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.428720 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.428820 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.429022 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.429108 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.429325 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.429427 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.429638 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.429731 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.429940 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.430205 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.430310 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.430565 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.430663 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.430884 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.430972 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.431192 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.431278 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.431502 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.431601 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.431825 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.432058 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.432152 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.432386 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.432479 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.432696 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.432783 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.433010 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.433104 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.433325 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.433411 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.433638 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.433737 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.433956 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.434041 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.434303 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.434393 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.434591 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.434695 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.434901 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.434995 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.435201 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.435287 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.435501 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.435587 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.435802 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.435887 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.436104 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.436188 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.436402 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.436487 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.436700 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.436794 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.436997 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.437093 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.437299 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.437393 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.437595 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.437687 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.437894 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.437986 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.438193 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.438313 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.438517 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.438606 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.438818 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.438902 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.439115 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.439213 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.439416 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.439502 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.439714 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.439799 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.440030 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.440128 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.440334 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.440426 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.440633 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.440730 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.440930 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.441016 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.441228 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.441313 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.441561 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.441648 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.441861 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.441955 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.442164 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.442249 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.442489 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.442782 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.442968 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.443085 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.443168 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.443246 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.443380 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.443517 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.443676 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.443838 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.443986 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.444099 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.444293 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.444391 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.444599 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.444685 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.444911 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.444998 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.445211 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.445305 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.445516 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.445609 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.445817 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.445911 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.446121 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.446218 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.446978 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.447074 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.447284 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.447371 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.447584 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.447678 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.447891 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.447977 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.448189 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.448274 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.448487 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.448582 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.448793 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.448879 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.449091 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.449184 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.449386 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.449478 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.449691 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.449777 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.449989 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.450075 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.450304 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.450393 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.450610 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.450696 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.450908 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.450993 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.451207 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.451301 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.451505 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.451597 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.451802 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.451905 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.452100 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.452194 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.452400 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.452484 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.452700 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.452835 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.452998 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.453083 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.453297 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.453383 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.453601 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.453694 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.453899 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.453985 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.454197 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.454299 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.454530 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.454632 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.454829 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.454914 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.455127 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.455213 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.455432 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.455519 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.455730 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.455814 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.456035 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.456121 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.456330 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.456415 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.456625 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.456710 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.456921 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.457006 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.457217 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.457311 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.457513 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.457598 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.457818 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.457902 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.458114 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.458201 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.458451 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.458537 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.458719 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.458814 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.459016 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.459101 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.459310 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.459395 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.459624 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.459718 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.459925 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.460011 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.460223 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.460319 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.460521 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.460616 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.460816 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.460903 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.461149 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.461235 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.461448 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.461542 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.461759 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.461843 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.462079 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.462191 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.462941 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.463030 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.463252 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.463337 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.463564 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.463650 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.463865 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.463960 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.464167 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.464252 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.464485 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.464572 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.464797 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.464884 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.465100 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.465184 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.465407 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.465493 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.465708 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.465795 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.466004 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.466090 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.466344 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.466435 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.466653 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.466739 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.466957 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.467050 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.467260 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.467353 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.467567 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.467660 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.467874 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.467960 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.468171 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.468265 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.468474 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.468560 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.468779 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.468866 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.469083 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.469177 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.469386 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.469479 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.469686 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.469770 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.469987 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.470152 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.470312 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.470402 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.470620 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.470717 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.470927 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.471013 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.471231 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.471325 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.471531 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.471615 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.471832 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.471918 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.472133 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.472224 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.472428 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.472514 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.472729 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.472820 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.473037 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.473150 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.473335 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.473461 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.473638 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.473862 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.473958 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.474073 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.474228 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.474409 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.474549 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.474720 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.474968 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.475061 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.475278 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.475376 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.475587 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.475673 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.475888 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.476023 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.476196 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.476336 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.476498 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.476645 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.476810 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.476955 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.477118 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.477281 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.477419 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.477545 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.477856 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.477944 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.478163 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.478250 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.478494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.478581 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.478796 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.478880 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.479093 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.479180 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.479391 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.479477 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.479697 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.479782 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.480013 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.480099 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.480311 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.480423 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.480608 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.480732 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.480906 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.481034 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.481218 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.481443 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.481537 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.481751 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.481838 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.482059 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.482207 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.482409 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.482536 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.482731 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.482819 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.483055 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.483224 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.483359 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.483531 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.483669 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.483835 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.483977 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.484150 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.484301 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.484464 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.484622 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.484780 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.484931 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.485077 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.485250 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.485384 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.485554 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.485950 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.486141 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.486306 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.486491 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.486590 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.486804 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.486900 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.487123 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.487217 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.487477 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.487562 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.487797 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.487957 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.488112 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.488198 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.488418 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.488506 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.488731 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.488828 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.489050 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.489135 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.489353 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.489547 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.489663 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.489758 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.489967 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.490060 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.490285 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.490375 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.490614 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.490702 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.490919 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.491006 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.491222 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.491314 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.491540 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.491633 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.491818 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.491911 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.492132 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.492226 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.492430 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.492517 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.492733 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.492819 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.493036 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.493121 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.493864 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.493970 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.494163 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.494251 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.494483 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.494582 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.494799 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.494886 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.495099 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.495187 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.495414 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.495508 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.495720 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.495806 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.496035 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.496122 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.496347 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.496443 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.496645 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.496732 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.496959 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.497052 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.497262 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.497362 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.497562 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.497649 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.497868 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.497961 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.498167 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.498304 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.498527 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.498612 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.498824 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.498909 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.499139 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.499226 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.499461 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.499548 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.499777 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.499869 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.500078 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.500164 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.500388 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.500481 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.500692 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.500787 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.501000 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.501087 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.501307 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.501393 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.501608 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.501704 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.501910 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.502010 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.502209 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.502314 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.502533 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.502628 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.502831 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.502917 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.503130 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.503216 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.503432 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.503527 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.503734 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.503821 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.504030 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.504117 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.504328 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.504423 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.504623 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.504709 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.504923 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.505117 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.505215 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.505296 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.505525 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.505602 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.505830 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.505924 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.506130 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.506218 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.506456 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.506544 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.506754 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.506841 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.507091 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.507178 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.507388 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.507481 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.507719 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.507812 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.508029 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.508121 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.508345 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.508439 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.508660 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.508754 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.509023 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.509609 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.509841 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.509936 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.510156 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.510254 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.510495 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.510580 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.510807 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.510904 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.511121 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.511217 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.511432 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.511519 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.511744 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.511838 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.512056 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.512264 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.512359 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.512594 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.512687 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.512910 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.513005 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.513224 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.513311 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.513535 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.513751 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.513837 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.514074 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.514161 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.514408 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.514509 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.514717 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.514803 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.515024 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.515120 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.515334 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.515421 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.515641 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.515736 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.515946 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.516033 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.516250 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.516336 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.516557 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.516653 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.516862 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.516950 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.517184 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.517270 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.517497 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.517658 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.517821 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.517908 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.518148 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.518236 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.518482 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.518570 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.518792 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.518879 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.519103 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.519189 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.519419 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.519507 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.519733 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.519827 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.520044 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.520139 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.520356 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.520442 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.520726 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.520820 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.520979 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.521065 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.521287 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.521380 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.521594 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.521686 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.521896 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.521989 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.522203 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.522336 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.522534 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.522632 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.522837 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.522925 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.523141 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.523228 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.523448 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.523534 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.523754 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.523842 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.524069 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.524154 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.524393 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.524607 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.524729 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.524924 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.525037 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.525257 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.525345 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.525585 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.525671 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.525915 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.526140 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.526227 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.526477 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.526577 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.526805 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.526891 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.527123 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.527209 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.527440 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.527538 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.527754 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.527839 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.528063 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.528149 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.528367 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.528460 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.528671 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.528756 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.528972 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.529153 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.529439 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.529570 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.529748 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.529896 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.530050 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.530209 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.530393 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.530701 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.530788 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.531001 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.531087 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.531316 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.531410 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.531621 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.531708 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.532027 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.532173 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.532374 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.532516 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.532684 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.532833 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.533006 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.533154 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.533312 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.533473 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.533619 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.533786 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.533935 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.534090 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.534246 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.534431 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.534569 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.534733 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.534878 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.535025 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.535185 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.535354 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.535493 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.535662 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.535801 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.535962 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.536111 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.536262 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.536476 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.536564 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.536730 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.536891 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.537039 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.537166 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.537323 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.537440 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.537626 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.537744 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.537935 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.538063 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.538238 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.538388 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.538569 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.538692 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.538875 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.538991 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.539178 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.539296 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.539490 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.539597 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.539793 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.539879 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.540102 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.540207 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.540436 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.540526 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.540747 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.540834 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.541050 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.541136 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.541359 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.541446 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.541655 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.541747 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.541960 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.542046 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.542295 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.542386 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.542582 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.542670 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.542922 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.543009 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.543233 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.543321 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.543529 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.543615 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.543850 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.543949 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.544135 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.544223 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.544438 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.544524 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.544755 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.544883 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.545063 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.545328 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.545416 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.545665 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.545759 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.545991 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.546084 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.546350 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.546542 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.546685 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.546871 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.546994 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.547186 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.547300 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.547513 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.547601 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.547846 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.547941 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.548148 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.548235 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.548448 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.548535 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.548747 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.548834 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.549066 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.549153 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.549371 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.549464 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.549678 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.549755 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.550027 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.550115 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.550301 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.550404 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.550610 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.550704 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.550916 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.551009 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.551218 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.551312 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.551524 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.551609 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.551826 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.551911 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.552131 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.552230 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.552436 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.552522 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.552739 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.552833 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.553040 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.553128 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.553348 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.553435 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.553673 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.553759 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.553982 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.554069 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.554313 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.554413 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.554625 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.554710 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.554933 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.555018 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.555236 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.555328 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.555543 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.555630 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.556359 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.556454 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.556668 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.556762 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.556982 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.557081 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.557307 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.557401 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.557615 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.557702 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.557914 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.558010 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.558302 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.558392 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.558620 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.558717 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.558940 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.559029 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.559251 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.559345 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.559554 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.559640 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.559863 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.559950 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.560179 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.560276 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.560485 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.560572 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.560799 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.560894 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.561104 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.561200 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.561421 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.561519 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.561723 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.561818 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.562026 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.562114 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.562359 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.562466 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.562673 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.562760 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.562972 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.563058 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.563270 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.563364 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.563571 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.563656 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.563876 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.563960 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.564176 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.564275 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.564472 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.564564 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.564770 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.564856 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.565068 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.565154 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.565364 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.565450 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.565661 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.565747 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.565959 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.566046 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.566253 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.566386 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.566576 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.566661 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.566872 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.566965 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.567168 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.567254 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.567465 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.567664 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.567765 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.567853 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.568065 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.568150 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.568364 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.568460 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.568664 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.568751 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.568959 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.569044 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.569255 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.569350 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.569551 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.569638 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.569846 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.569939 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.570141 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.570251 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.570490 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.570602 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.570812 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.570905 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.571118 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.571213 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.571539 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.572121 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.572349 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.572605 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.572700 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.572952 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.573071 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.573265 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.573546 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.573632 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.573875 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.574037 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.574176 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.574526 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.574614 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.574832 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.575018 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.575138 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.575443 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.575528 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.575750 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.575952 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.576051 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.576343 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.576439 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.576665 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.576887 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.577050 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.577274 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.577361 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.577591 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.577846 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.577941 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.578211 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.578323 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.578546 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.578798 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.578885 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.579161 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.579255 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.579467 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.579713 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.579798 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.580063 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.580160 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.580368 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.580662 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.580759 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.580967 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.581198 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.581293 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.581561 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.581647 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.581870 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.582093 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.582188 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.582513 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.582601 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.582834 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.583023 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.583228 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.583442 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.583529 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.583758 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.583948 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.584096 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.584403 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.584495 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.584736 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.584870 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.585056 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.585342 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.585428 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.585658 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.585811 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.585957 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.586195 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 15:22:29.586328 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.586755 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.587176 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.587583 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.587996 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.588421 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.588816 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.589283 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.589688 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.590082 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.590573 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.590979 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:22:29.591348 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 15:22:29.648532 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO dbcounter [None req-63a32cea-f6ba-4bf0-9532-f5f3cd3938b7 None None] Registered counter for database nova_api Jul 20 15:22:29.653594 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO dbcounter [None req-f002eaf1-6980-43c7-8691-8d0217287ff9 None None] Registered counter for database nova_api Jul 20 15:22:29.762025 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_db.sqlalchemy.engines [None req-63a32cea-f6ba-4bf0-9532-f5f3cd3938b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 15:22:29.765112 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG oslo_db.sqlalchemy.engines [None req-f002eaf1-6980-43c7-8691-8d0217287ff9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103761) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 15:22:29.768513 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG dbcounter [-] [103760] Writer thread running {{(pid=103760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 15:22:29.771443 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG dbcounter [-] [103761] Writer thread running {{(pid=103761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 15:22:29.823629 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.context [None req-63a32cea-f6ba-4bf0-9532-f5f3cd3938b7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),794b77f4-e750-4ef6-ba0b-862dc242f7fe(cell1) {{(pid=103760) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 15:22:29.826532 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.context [None req-f002eaf1-6980-43c7-8691-8d0217287ff9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),794b77f4-e750-4ef6-ba0b-862dc242f7fe(cell1) {{(pid=103761) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 15:22:29.827569 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_concurrency.lockutils [None req-63a32cea-f6ba-4bf0-9532-f5f3cd3938b7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:22:29.829120 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_concurrency.lockutils [None req-63a32cea-f6ba-4bf0-9532-f5f3cd3938b7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:22:29.829896 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_concurrency.lockutils [None req-63a32cea-f6ba-4bf0-9532-f5f3cd3938b7 None None] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:22:29.830432 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG oslo_concurrency.lockutils [None req-f002eaf1-6980-43c7-8691-8d0217287ff9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:22:29.831995 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG oslo_concurrency.lockutils [None req-f002eaf1-6980-43c7-8691-8d0217287ff9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:22:29.832087 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_concurrency.lockutils [None req-63a32cea-f6ba-4bf0-9532-f5f3cd3938b7 None None] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:22:29.832781 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG oslo_concurrency.lockutils [None req-f002eaf1-6980-43c7-8691-8d0217287ff9 None None] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:22:29.833961 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO dbcounter [None req-63a32cea-f6ba-4bf0-9532-f5f3cd3938b7 None None] Registered counter for database nova_cell0 Jul 20 15:22:29.834907 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG oslo_concurrency.lockutils [None req-f002eaf1-6980-43c7-8691-8d0217287ff9 None None] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103761) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:22:29.836867 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO dbcounter [None req-f002eaf1-6980-43c7-8691-8d0217287ff9 None None] Registered counter for database nova_cell0 Jul 20 15:22:29.837746 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO dbcounter [None req-63a32cea-f6ba-4bf0-9532-f5f3cd3938b7 None None] Registered counter for database nova_cell1 Jul 20 15:22:29.840656 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO dbcounter [None req-f002eaf1-6980-43c7-8691-8d0217287ff9 None None] Registered counter for database nova_cell1 Jul 20 15:22:29.845985 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_db.sqlalchemy.engines [None req-63a32cea-f6ba-4bf0-9532-f5f3cd3938b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 15:22:29.846784 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_db.sqlalchemy.engines [None req-63a32cea-f6ba-4bf0-9532-f5f3cd3938b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 15:22:29.848611 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG oslo_db.sqlalchemy.engines [None req-f002eaf1-6980-43c7-8691-8d0217287ff9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103761) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 15:22:29.850211 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG oslo_db.sqlalchemy.engines [None req-f002eaf1-6980-43c7-8691-8d0217287ff9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103761) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 15:22:29.854223 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG dbcounter [-] [103760] Writer thread running {{(pid=103760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 15:22:29.855556 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG dbcounter [-] [103760] Writer thread running {{(pid=103760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 15:22:29.856572 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG dbcounter [-] [103761] Writer thread running {{(pid=103761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 15:22:29.858634 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG dbcounter [-] [103761] Writer thread running {{(pid=103761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 15:22:29.999999 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO dbcounter [None req-63a32cea-f6ba-4bf0-9532-f5f3cd3938b7 None None] Registered counter for database nova_cell0 Jul 20 15:22:30.002682 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO dbcounter [None req-f002eaf1-6980-43c7-8691-8d0217287ff9 None None] Registered counter for database nova_cell0 Jul 20 15:22:30.008630 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_db.sqlalchemy.engines [None req-63a32cea-f6ba-4bf0-9532-f5f3cd3938b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 15:22:30.012114 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG oslo_db.sqlalchemy.engines [None req-f002eaf1-6980-43c7-8691-8d0217287ff9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103761) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 15:22:30.013017 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG dbcounter [-] [103760] Writer thread running {{(pid=103760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 15:22:30.016419 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG dbcounter [-] [103761] Writer thread running {{(pid=103761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 15:22:30.441717 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: WARNING keystonemiddleware.auth_token [None req-63a32cea-f6ba-4bf0-9532-f5f3cd3938b7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 15:22:30.449048 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: WARNING keystonemiddleware.auth_token [None req-63a32cea-f6ba-4bf0-9532-f5f3cd3938b7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 15:22:30.469720 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: WARNING keystonemiddleware.auth_token [None req-f002eaf1-6980-43c7-8691-8d0217287ff9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 15:22:30.477142 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: WARNING keystonemiddleware.auth_token [None req-f002eaf1-6980-43c7-8691-8d0217287ff9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 15:22:30.787204 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: WARNING keystonemiddleware.auth_token [None req-63a32cea-f6ba-4bf0-9532-f5f3cd3938b7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 15:22:30.793186 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: WARNING keystonemiddleware.auth_token [None req-63a32cea-f6ba-4bf0-9532-f5f3cd3938b7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 15:22:30.798462 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56430f8189c0 pid: 103760 (default app) Jul 20 15:22:30.800494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-63a32cea-f6ba-4bf0-9532-f5f3cd3938b7 None None] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:22:30.801661 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-63a32cea-f6ba-4bf0-9532-f5f3cd3938b7 None None] 10.222.0.78 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001699 Jul 20 15:22:30.802294 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 788 bytes} [Wed Jul 20 15:22:30 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:22:30.816683 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: WARNING keystonemiddleware.auth_token [None req-f002eaf1-6980-43c7-8691-8d0217287ff9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 15:22:30.823219 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: WARNING keystonemiddleware.auth_token [None req-f002eaf1-6980-43c7-8691-8d0217287ff9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 15:22:30.828478 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56430f8189c0 pid: 103761 (default app) Jul 20 15:23:51.775740 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-63a32cea-f6ba-4bf0-9532-f5f3cd3938b7 None None] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:23:51.776921 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-63a32cea-f6ba-4bf0-9532-f5f3cd3938b7 None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Jul 20 15:23:51.777321 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 2/2] 10.222.0.78 () {54 vars in 930 bytes} [Wed Jul 20 15:23:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:23:51.790227 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG dbcounter [-] [103761] Writing DB stats nova_api:SELECT=3 {{(pid=103761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:51.791206 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG dbcounter [-] [103761] Writing DB stats nova_cell0:SELECT=3 {{(pid=103761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:51.791918 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG dbcounter [-] [103761] Writing DB stats nova_cell1:SELECT=3 {{(pid=103761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:51.792973 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG dbcounter [-] [103761] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:52.687436 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-890fb4ee-8880-4b41-9b1e-6b406e89bc9a admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:23:52.717112 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-890fb4ee-8880-4b41-9b1e-6b406e89bc9a admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.932926 Jul 20 15:23:52.722748 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 1/3] 10.222.0.78 () {60 vars in 1291 bytes} [Wed Jul 20 15:23:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:23:55.018603 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-63a32cea-f6ba-4bf0-9532-f5f3cd3938b7 None None] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:23:55.020372 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-63a32cea-f6ba-4bf0-9532-f5f3cd3938b7 None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002232 Jul 20 15:23:55.020940 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 3/4] 10.222.0.78 () {54 vars in 930 bytes} [Wed Jul 20 15:23:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:23:55.559196 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-c28d74bd-c686-4e9e-bae7-7883e898304f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256", "disk": 1, "vcpus": 1, "id": "c1", "ram": 256}} {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:23:55.580386 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:23:55.580386 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: warnings.warn(msg) Jul 20 15:23:55.680847 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-c28d74bd-c686-4e9e-bae7-7883e898304f admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.651962 Jul 20 15:23:55.681536 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 2/5] 10.222.0.78 () {64 vars in 1282 bytes} [Wed Jul 20 15:23:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 15:23:55.898383 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-a333fdac-1469-4516-a68d-cb95829e98b3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:23:55.900842 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:23:55.900842 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: warnings.warn(msg) Jul 20 15:23:55.903568 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG dbcounter [-] [103760] Writing DB stats nova_api:SELECT=3 {{(pid=103760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:55.904652 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG dbcounter [-] [103760] Writing DB stats nova_cell0:SELECT=3 {{(pid=103760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:55.905175 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG dbcounter [-] [103760] Writing DB stats nova_cell1:SELECT=3 {{(pid=103760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:55.905975 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG dbcounter [-] [103760] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:23:56.062868 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-a333fdac-1469-4516-a68d-cb95829e98b3 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.373113 Jul 20 15:23:56.063580 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 4/6] 10.222.0.78 () {64 vars in 1335 bytes} [Wed Jul 20 15:23:55 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:23:58.351038 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-c28d74bd-c686-4e9e-bae7-7883e898304f admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:23:58.351964 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-c28d74bd-c686-4e9e-bae7-7883e898304f admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001631 Jul 20 15:23:58.352366 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 3/7] 10.222.0.78 () {54 vars in 930 bytes} [Wed Jul 20 15:23:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:23:59.143596 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-a9bade8d-88d7-4c6d-a7ce-1e43dd384322 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "disk": 5, "name": "ds512M", "id": "d1", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:23:59.162496 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:23:59.162496 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: warnings.warn(msg) Jul 20 15:23:59.279523 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-a9bade8d-88d7-4c6d-a7ce-1e43dd384322 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.920445 Jul 20 15:23:59.280556 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 5/8] 10.222.0.78 () {64 vars in 1282 bytes} [Wed Jul 20 15:23:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 15:23:59.293344 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-83a3b73e-2598-4d69-8da9-28a3ca5ed5f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:23:59.295638 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:23:59.295638 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: warnings.warn(msg) Jul 20 15:23:59.397870 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-83a3b73e-2598-4d69-8da9-28a3ca5ed5f3 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108971 Jul 20 15:23:59.402438 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 4/9] 10.222.0.78 () {64 vars in 1335 bytes} [Wed Jul 20 15:23:59 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:24:01.669450 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-a9bade8d-88d7-4c6d-a7ce-1e43dd384322 admin admin] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:01.670512 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-a9bade8d-88d7-4c6d-a7ce-1e43dd384322 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 20 15:24:01.670910 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 6/10] 10.222.0.78 () {54 vars in 930 bytes} [Wed Jul 20 15:24:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:24:02.114192 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-ff79ebcd-5a3f-477a-aad7-1896b1860164 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "os-flavor-access:is_public": true, "swap": 0, "ram": 1024, "rxtx_factor": 1.0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:24:02.190912 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-ff79ebcd-5a3f-477a-aad7-1896b1860164 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.513610 Jul 20 15:24:02.191312 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 5/11] 10.222.0.78 () {64 vars in 1282 bytes} [Wed Jul 20 15:24:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 15:24:02.203644 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-3152d482-c3b2-41f9-a9ae-b1637703af7c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:24:02.301715 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-3152d482-c3b2-41f9-a9ae-b1637703af7c admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101915 Jul 20 15:24:02.302318 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 7/12] 10.222.0.78 () {64 vars in 1335 bytes} [Wed Jul 20 15:24:02 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:24:04.579570 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-ff79ebcd-5a3f-477a-aad7-1896b1860164 admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:04.581108 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-ff79ebcd-5a3f-477a-aad7-1896b1860164 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001979 Jul 20 15:24:04.581961 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 6/13] 10.222.0.78 () {54 vars in 930 bytes} [Wed Jul 20 15:24:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:24:05.087581 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-7c3ba7e9-6910-4e53-aed0-d8a0e86f1c90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "name": "ds2G", "disk": 10}} {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:24:05.189637 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-7c3ba7e9-6910-4e53-aed0-d8a0e86f1c90 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.600204 Jul 20 15:24:05.190309 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 8/14] 10.222.0.78 () {64 vars in 1282 bytes} [Wed Jul 20 15:24:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 15:24:05.202473 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-34067a28-81bb-4925-946f-92d314bb32cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:24:05.285194 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-34067a28-81bb-4925-946f-92d314bb32cc admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086341 Jul 20 15:24:05.285839 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 7/15] 10.222.0.78 () {64 vars in 1335 bytes} [Wed Jul 20 15:24:05 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:24:07.632551 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-7c3ba7e9-6910-4e53-aed0-d8a0e86f1c90 admin admin] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:07.634114 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-7c3ba7e9-6910-4e53-aed0-d8a0e86f1c90 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002035 Jul 20 15:24:07.645121 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 9/16] 10.222.0.78 () {54 vars in 930 bytes} [Wed Jul 20 15:24:07 2022] GET /compute/v2.1 => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:24:08.087809 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-7c48bcd3-f675-4384-892d-ed6d7169274d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "ram": 4096, "id": "d4", "rxtx_factor": 1.0}} {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:24:08.193523 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-7c48bcd3-f675-4384-892d-ed6d7169274d admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.552646 Jul 20 15:24:08.194097 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 8/17] 10.222.0.78 () {64 vars in 1282 bytes} [Wed Jul 20 15:24:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 15:24:08.207023 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-e161807e-5314-4c50-bbcf-111a5fdc75c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:24:08.299839 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-e161807e-5314-4c50-bbcf-111a5fdc75c8 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096674 Jul 20 15:24:08.300687 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 10/18] 10.222.0.78 () {64 vars in 1335 bytes} [Wed Jul 20 15:24:08 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:24:10.552196 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-7c48bcd3-f675-4384-892d-ed6d7169274d admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:10.553218 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-7c48bcd3-f675-4384-892d-ed6d7169274d admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jul 20 15:24:10.553634 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 9/19] 10.222.0.78 () {54 vars in 930 bytes} [Wed Jul 20 15:24:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:24:11.003330 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-79c21ae7-e9b2-414d-8b7c-239d33583f9c admin admin] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:11.026772 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-79c21ae7-e9b2-414d-8b7c-239d33583f9c admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.465684 Jul 20 15:24:11.027325 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 11/20] 10.222.0.78 () {60 vars in 1291 bytes} [Wed Jul 20 15:24:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:24:13.530099 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-7c48bcd3-f675-4384-892d-ed6d7169274d admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:13.531176 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-7c48bcd3-f675-4384-892d-ed6d7169274d admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001610 Jul 20 15:24:13.531712 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 10/21] 10.222.0.78 () {54 vars in 930 bytes} [Wed Jul 20 15:24:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:24:13.957978 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-f67c1169-ea0a-49e2-b951-d0c25822b39f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "disk": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "rxtx_factor": 1.0, "ram": 512}} {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:24:14.029554 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-f67c1169-ea0a-49e2-b951-d0c25822b39f admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.491802 Jul 20 15:24:14.030119 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 12/22] 10.222.0.78 () {64 vars in 1282 bytes} [Wed Jul 20 15:24:13 2022] POST /compute/v2.1/flavors => generated 402 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 15:24:14.042555 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-41ead3ef-78f9-40af-a75b-6befbf370e42 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:24:14.129957 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-41ead3ef-78f9-40af-a75b-6befbf370e42 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091594 Jul 20 15:24:14.130629 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 11/23] 10.222.0.78 () {64 vars in 1332 bytes} [Wed Jul 20 15:24:14 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:24:16.359451 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-f67c1169-ea0a-49e2-b951-d0c25822b39f admin admin] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:16.360408 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-f67c1169-ea0a-49e2-b951-d0c25822b39f admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 20 15:24:16.360812 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 13/24] 10.222.0.78 () {54 vars in 930 bytes} [Wed Jul 20 15:24:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:24:16.764630 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-e08ccb7b-4c58-4963-84b3-062016129fc3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:24:16.823371 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-e08ccb7b-4c58-4963-84b3-062016129fc3 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.456798 Jul 20 15:24:16.823922 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 12/25] 10.222.0.78 () {64 vars in 1282 bytes} [Wed Jul 20 15:24:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 15:24:16.835858 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-0ca50180-e046-48f9-9f8f-22e9ab7a30d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:24:16.900971 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-0ca50180-e046-48f9-9f8f-22e9ab7a30d7 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068673 Jul 20 15:24:16.901495 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 14/26] 10.222.0.78 () {64 vars in 1332 bytes} [Wed Jul 20 15:24:16 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:24:19.158440 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-e08ccb7b-4c58-4963-84b3-062016129fc3 admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:19.159637 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-e08ccb7b-4c58-4963-84b3-062016129fc3 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001767 Jul 20 15:24:19.160048 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 13/27] 10.222.0.78 () {54 vars in 930 bytes} [Wed Jul 20 15:24:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:24:19.532582 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-04e2d93f-4605-445d-9772-612499de47f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "m1.medium", "id": "3", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 40, "vcpus": 2}} {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:24:19.623238 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-04e2d93f-4605-445d-9772-612499de47f7 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.456896 Jul 20 15:24:19.623815 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 15/28] 10.222.0.78 () {64 vars in 1282 bytes} [Wed Jul 20 15:24:19 2022] POST /compute/v2.1/flavors => generated 406 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 15:24:19.635786 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-9b84c238-504f-41d9-80b6-61eeae1dbb90 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:24:19.724196 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-9b84c238-504f-41d9-80b6-61eeae1dbb90 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091916 Jul 20 15:24:19.724712 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 14/29] 10.222.0.78 () {64 vars in 1332 bytes} [Wed Jul 20 15:24:19 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:24:22.016287 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-04e2d93f-4605-445d-9772-612499de47f7 admin admin] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:22.027809 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-04e2d93f-4605-445d-9772-612499de47f7 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002350 Jul 20 15:24:22.074498 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 16/30] 10.222.0.78 () {54 vars in 930 bytes} [Wed Jul 20 15:24:22 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:24:22.539425 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-3d381623-b164-4d9b-ac74-08b0ddb97daa admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "4", "disk": 80, "ram": 8192}} {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:24:22.544599 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG dbcounter [-] [103761] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:22.698579 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-3d381623-b164-4d9b-ac74-08b0ddb97daa admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.672454 Jul 20 15:24:22.711343 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-975a1304-9548-428b-91dc-bd3d1a6b9f85 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:24:22.716215 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 15/31] 10.222.0.78 () {64 vars in 1282 bytes} [Wed Jul 20 15:24:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 15:24:22.832964 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-975a1304-9548-428b-91dc-bd3d1a6b9f85 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124509 Jul 20 15:24:22.833611 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 17/32] 10.222.0.78 () {64 vars in 1332 bytes} [Wed Jul 20 15:24:22 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:24:25.275858 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-3d381623-b164-4d9b-ac74-08b0ddb97daa admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:25.276875 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-3d381623-b164-4d9b-ac74-08b0ddb97daa admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 20 15:24:25.277280 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 16/33] 10.222.0.78 () {54 vars in 930 bytes} [Wed Jul 20 15:24:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:24:25.718297 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-f17097ac-a05c-4a08-8108-aa38d5465723 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "ram": 16384, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:24:25.811783 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-f17097ac-a05c-4a08-8108-aa38d5465723 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.527655 Jul 20 15:24:25.821872 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 18/34] 10.222.0.78 () {64 vars in 1282 bytes} [Wed Jul 20 15:24:25 2022] POST /compute/v2.1/flavors => generated 408 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 15:24:25.825704 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-a9bba79d-ea4a-4743-8a57-0bac240c85aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:24:26.129025 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-a9bba79d-ea4a-4743-8a57-0bac240c85aa admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.307970 Jul 20 15:24:26.129656 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 17/35] 10.222.0.78 () {64 vars in 1332 bytes} [Wed Jul 20 15:24:25 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:24:46.707609 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-f17097ac-a05c-4a08-8108-aa38d5465723 admin admin] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:46.708686 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-f17097ac-a05c-4a08-8108-aa38d5465723 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 20 15:24:46.709086 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 19/36] 10.222.0.78 () {54 vars in 930 bytes} [Wed Jul 20 15:24:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:24:46.719481 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG dbcounter [-] [103761] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:47.111447 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-850ad26b-937f-42b0-92e9-4b7b308b9476 admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:47.129169 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-850ad26b-937f-42b0-92e9-4b7b308b9476 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.414089 Jul 20 15:24:47.129819 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 18/37] 10.222.0.78 () {60 vars in 1291 bytes} [Wed Jul 20 15:24:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:24:48.198225 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-f17097ac-a05c-4a08-8108-aa38d5465723 admin admin] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:48.199250 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-f17097ac-a05c-4a08-8108-aa38d5465723 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 20 15:24:48.199659 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 20/38] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Jul 20 15:24:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:24:48.763088 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-1fd84c2b-ebf9-477b-a7c4-45056093795e admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:48.768911 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.wsgi [None req-1fd84c2b-ebf9-477b-a7c4-45056093795e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 15:24:48.772859 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-1fd84c2b-ebf9-477b-a7c4-45056093795e admin admin] Request method failure captured: Jul 20 15:24:48.772859 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 15:24:48.772859 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: Accept: application/json Jul 20 15:24:48.772859 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: Accept-Encoding: gzip, deflate Jul 20 15:24:48.772859 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: Connection: keep-alive Jul 20 15:24:48.772859 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: Content-Length: 0 Jul 20 15:24:48.772859 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: Host: 10.222.0.78 Jul 20 15:24:48.772859 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: Openstack-Api-Version: compute 2.90 Jul 20 15:24:48.772859 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: Openstack-System-Scope: None Jul 20 15:24:48.772859 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: User-Agent: python-novaclient Jul 20 15:24:48.772859 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Auth-Token: gAAAAABi2B5AGiUvmE18ctx-cdk6qHEqeTD9kmehpuXBfcGarRFXD84rX6GfsgVaYbi35_lBkZqa47T9RAmN3SkLWAc2NUVy7TKmi5ZOyW-z0d8gdmXbkpdi53bF4cSItaN5Ji0QOJv_GOES12iVlCDZ1w3JVCiaXbRSWEhkyIERg3MUHmYSjkc Jul 20 15:24:48.772859 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Domain-Id: None Jul 20 15:24:48.772859 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Domain-Name: None Jul 20 15:24:48.772859 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Identity-Status: Confirmed Jul 20 15:24:48.772859 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Is-Admin-Project: True Jul 20 15:24:48.772859 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 15:24:48.772859 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Project-Domain-Id: default Jul 20 15:24:48.772859 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Project-Domain-Name: Default Jul 20 15:24:48.772859 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Project-Id: effa579779b9494f8b1dd5831edaae25 Jul 20 15:24:48.772859 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Project-Name: admin Jul 20 15:24:48.772859 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Role: admin,member,reader Jul 20 15:24:48.772859 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Roles: admin,member,reader Jul 20 15:24:48.774667 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/effa579779b9494f8b1dd5831edaae25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/effa579779b9494f8b1dd5831edaae25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_effa579779b9494f8b1dd5831edaae25", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/effa579779b9494f8b1dd5831edaae25"}]}] Jul 20 15:24:48.774667 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Tenant: admin Jul 20 15:24:48.774667 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Tenant-Id: effa579779b9494f8b1dd5831edaae25 Jul 20 15:24:48.774667 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Tenant-Name: admin Jul 20 15:24:48.774667 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-User: admin Jul 20 15:24:48.774667 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-User-Domain-Id: default Jul 20 15:24:48.774667 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-User-Domain-Name: Default Jul 20 15:24:48.774667 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-User-Id: 6049ef02a0334b599d9582b3c2aa2ebf Jul 20 15:24:48.774667 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-User-Name: admin Jul 20 15:24:48.774667 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: method: > Jul 20 15:24:48.774667 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: exception: Flavor 42 could not be found. Jul 20 15:24:48.774667 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: action_args: {'id': '42'} Jul 20 15:24:48.774667 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:24:48.774667 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:24:48.775779 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 15:24:48.775779 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 15:24:48.775779 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 15:24:48.775779 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 15:24:48.775779 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 15:24:48.775779 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 15:24:48.775779 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 15:24:48.775779 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 15:24:48.775779 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 15:24:48.775779 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:24:48.775779 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 15:24:48.775779 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 15:24:48.775779 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 15:24:48.775779 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Jul 20 15:24:48.775779 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:24:48.775779 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Jul 20 15:24:48.775779 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:24:48.775779 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:24:48.775779 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:24:48.778039 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:24:48.778039 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:24:48.778039 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:24:48.778039 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:24:48.778039 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 15:24:48.778039 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:24:48.778039 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 15:24:48.778039 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Jul 20 15:24:48.778039 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:24:48.778039 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Jul 20 15:24:48.778039 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:24:48.778039 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:24:48.778039 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:24:48.778039 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:24:48.778039 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:24:48.778039 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 15:24:48.778039 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Jul 20 15:24:48.778039 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-1fd84c2b-ebf9-477b-a7c4-45056093795e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:24:48.781068 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-1fd84c2b-ebf9-477b-a7c4-45056093795e admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.437010 Jul 20 15:24:48.781068 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 19/39] 10.222.0.78 () {60 vars in 1190 bytes} [Wed Jul 20 15:24:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 15:24:48.785105 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-ccab8be0-2232-49c5-9bab-e706574189d8 admin admin] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:48.788074 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG dbcounter [-] [103760] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:24:48.809409 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-ccab8be0-2232-49c5-9bab-e706574189d8 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028358 Jul 20 15:24:48.810043 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 21/40] 10.222.0.78 () {60 vars in 1210 bytes} [Wed Jul 20 15:24:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:24:48.820630 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-73cf1c76-cddf-4b93-8df9-2ed88859ba6c admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:48.843212 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-73cf1c76-cddf-4b93-8df9-2ed88859ba6c admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026632 Jul 20 15:24:48.843797 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 20/41] 10.222.0.78 () {60 vars in 1210 bytes} [Wed Jul 20 15:24:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:24:48.855381 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-061cb1b5-a228-469e-ab82-f720afafa3c3 admin admin] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:48.865076 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.wsgi [None req-061cb1b5-a228-469e-ab82-f720afafa3c3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 15:24:48.870293 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-061cb1b5-a228-469e-ab82-f720afafa3c3 admin admin] Request method failure captured: Jul 20 15:24:48.870293 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 15:24:48.870293 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: Accept: application/json Jul 20 15:24:48.870293 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: Accept-Encoding: gzip, deflate Jul 20 15:24:48.870293 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: Connection: keep-alive Jul 20 15:24:48.870293 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: Content-Length: 0 Jul 20 15:24:48.870293 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: Host: 10.222.0.78 Jul 20 15:24:48.870293 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: Openstack-Api-Version: compute 2.90 Jul 20 15:24:48.870293 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: Openstack-System-Scope: None Jul 20 15:24:48.870293 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: User-Agent: python-novaclient Jul 20 15:24:48.870293 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Auth-Token: gAAAAABi2B5AGiUvmE18ctx-cdk6qHEqeTD9kmehpuXBfcGarRFXD84rX6GfsgVaYbi35_lBkZqa47T9RAmN3SkLWAc2NUVy7TKmi5ZOyW-z0d8gdmXbkpdi53bF4cSItaN5Ji0QOJv_GOES12iVlCDZ1w3JVCiaXbRSWEhkyIERg3MUHmYSjkc Jul 20 15:24:48.870293 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Domain-Id: None Jul 20 15:24:48.870293 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Domain-Name: None Jul 20 15:24:48.870293 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Identity-Status: Confirmed Jul 20 15:24:48.870293 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Is-Admin-Project: True Jul 20 15:24:48.870293 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 15:24:48.870293 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Project-Domain-Id: default Jul 20 15:24:48.870293 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Project-Domain-Name: Default Jul 20 15:24:48.870293 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Project-Id: effa579779b9494f8b1dd5831edaae25 Jul 20 15:24:48.870293 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Project-Name: admin Jul 20 15:24:48.870293 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Role: admin,member,reader Jul 20 15:24:48.870293 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Roles: admin,member,reader Jul 20 15:24:48.871594 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/effa579779b9494f8b1dd5831edaae25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/effa579779b9494f8b1dd5831edaae25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_effa579779b9494f8b1dd5831edaae25", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/effa579779b9494f8b1dd5831edaae25"}]}] Jul 20 15:24:48.871594 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Tenant: admin Jul 20 15:24:48.871594 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Tenant-Id: effa579779b9494f8b1dd5831edaae25 Jul 20 15:24:48.871594 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Tenant-Name: admin Jul 20 15:24:48.871594 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-User: admin Jul 20 15:24:48.871594 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-User-Domain-Id: default Jul 20 15:24:48.871594 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-User-Domain-Name: Default Jul 20 15:24:48.871594 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-User-Id: 6049ef02a0334b599d9582b3c2aa2ebf Jul 20 15:24:48.871594 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-User-Name: admin Jul 20 15:24:48.871594 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: method: > Jul 20 15:24:48.871594 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: exception: Flavor 42 could not be found. Jul 20 15:24:48.871594 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: action_args: {'id': '42'} Jul 20 15:24:48.871594 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:24:48.871594 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:24:48.872441 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 15:24:48.872441 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 15:24:48.872441 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 15:24:48.872441 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 15:24:48.872441 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 15:24:48.872441 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 15:24:48.872441 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 15:24:48.872441 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 15:24:48.872441 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 15:24:48.872441 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:24:48.872441 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 15:24:48.872441 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 15:24:48.872441 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 15:24:48.872441 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Jul 20 15:24:48.872441 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:24:48.872441 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Jul 20 15:24:48.872441 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:24:48.872441 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:24:48.872441 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:24:48.873780 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:24:48.873780 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:24:48.873780 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:24:48.873780 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:24:48.873780 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 15:24:48.873780 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:24:48.873780 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 15:24:48.873780 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Jul 20 15:24:48.873780 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:24:48.873780 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Jul 20 15:24:48.873780 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:24:48.873780 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:24:48.873780 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:24:48.873780 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:24:48.873780 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:24:48.873780 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 15:24:48.873780 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Jul 20 15:24:48.873780 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-061cb1b5-a228-469e-ab82-f720afafa3c3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:24:48.875087 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-061cb1b5-a228-469e-ab82-f720afafa3c3 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.022291 Jul 20 15:24:48.875087 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 22/42] 10.222.0.78 () {60 vars in 1190 bytes} [Wed Jul 20 15:24:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 15:24:49.865108 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-73cf1c76-cddf-4b93-8df9-2ed88859ba6c admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:49.866128 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-73cf1c76-cddf-4b93-8df9-2ed88859ba6c admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jul 20 15:24:49.866558 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 21/43] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Jul 20 15:24:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:24:50.400184 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-1710367b-465f-4e0b-8272-bd247e4bdae9 admin admin] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:50.405981 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.wsgi [None req-1710367b-465f-4e0b-8272-bd247e4bdae9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 15:24:50.407494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-1710367b-465f-4e0b-8272-bd247e4bdae9 admin admin] Request method failure captured: Jul 20 15:24:50.407494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 15:24:50.407494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: Accept: application/json Jul 20 15:24:50.407494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: Accept-Encoding: gzip, deflate Jul 20 15:24:50.407494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: Connection: keep-alive Jul 20 15:24:50.407494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: Content-Length: 0 Jul 20 15:24:50.407494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: Host: 10.222.0.78 Jul 20 15:24:50.407494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: Openstack-Api-Version: compute 2.90 Jul 20 15:24:50.407494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: Openstack-System-Scope: None Jul 20 15:24:50.407494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: User-Agent: python-novaclient Jul 20 15:24:50.407494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Auth-Token: gAAAAABi2B5B0-E9tFbzKmtgp571fim3f8Dtlz6UGsz1NpyqNLYTL30KAf9ejCyLZRyorkwb4uYl7gwr8rLLf09p9Sj6_9ZwQ_MEikYLq9biuHDs9N9U3g1l5yLw1SGoTOpnz_lC4mfWH_c3d2klPf0HRgIp2sNgIoacwGHWvoR-cmyddY8bsQQ Jul 20 15:24:50.407494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Domain-Id: None Jul 20 15:24:50.407494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Domain-Name: None Jul 20 15:24:50.407494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Identity-Status: Confirmed Jul 20 15:24:50.407494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Is-Admin-Project: True Jul 20 15:24:50.407494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 15:24:50.407494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Project-Domain-Id: default Jul 20 15:24:50.407494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Project-Domain-Name: Default Jul 20 15:24:50.407494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Project-Id: effa579779b9494f8b1dd5831edaae25 Jul 20 15:24:50.407494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Project-Name: admin Jul 20 15:24:50.407494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Role: admin,member,reader Jul 20 15:24:50.407494 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Roles: admin,member,reader Jul 20 15:24:50.409058 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/effa579779b9494f8b1dd5831edaae25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/effa579779b9494f8b1dd5831edaae25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_effa579779b9494f8b1dd5831edaae25", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/effa579779b9494f8b1dd5831edaae25"}]}] Jul 20 15:24:50.409058 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Tenant: admin Jul 20 15:24:50.409058 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Tenant-Id: effa579779b9494f8b1dd5831edaae25 Jul 20 15:24:50.409058 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Tenant-Name: admin Jul 20 15:24:50.409058 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-User: admin Jul 20 15:24:50.409058 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-User-Domain-Id: default Jul 20 15:24:50.409058 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-User-Domain-Name: Default Jul 20 15:24:50.409058 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-User-Id: 6049ef02a0334b599d9582b3c2aa2ebf Jul 20 15:24:50.409058 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-User-Name: admin Jul 20 15:24:50.409058 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: method: > Jul 20 15:24:50.409058 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: exception: Flavor 84 could not be found. Jul 20 15:24:50.409058 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: action_args: {'id': '84'} Jul 20 15:24:50.409058 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:24:50.409058 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:24:50.410050 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 15:24:50.410050 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 15:24:50.410050 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 15:24:50.410050 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 15:24:50.410050 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 15:24:50.410050 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 15:24:50.410050 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 15:24:50.410050 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 15:24:50.410050 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 15:24:50.410050 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:24:50.410050 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 15:24:50.410050 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 15:24:50.410050 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 15:24:50.410050 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Jul 20 15:24:50.410050 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:24:50.410050 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Jul 20 15:24:50.410050 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:24:50.410050 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:24:50.410050 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:24:50.411480 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:24:50.411480 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:24:50.411480 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:24:50.411480 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:24:50.411480 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 15:24:50.411480 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:24:50.411480 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 15:24:50.411480 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Jul 20 15:24:50.411480 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:24:50.411480 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Jul 20 15:24:50.411480 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:24:50.411480 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:24:50.411480 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:24:50.411480 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:24:50.411480 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:24:50.411480 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 15:24:50.411480 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Jul 20 15:24:50.411480 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-1710367b-465f-4e0b-8272-bd247e4bdae9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:24:50.412736 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-1710367b-465f-4e0b-8272-bd247e4bdae9 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.404009 Jul 20 15:24:50.412736 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 23/44] 10.222.0.78 () {60 vars in 1190 bytes} [Wed Jul 20 15:24:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 15:24:50.418756 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-e4b1e06f-a711-4f68-8bf8-fed6c350fb69 admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:50.432595 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-e4b1e06f-a711-4f68-8bf8-fed6c350fb69 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017406 Jul 20 15:24:50.433113 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 22/45] 10.222.0.78 () {60 vars in 1210 bytes} [Wed Jul 20 15:24:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:24:50.442693 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-f4d0c522-a696-421e-91cb-23e4eab3ae36 admin admin] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:50.457077 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-f4d0c522-a696-421e-91cb-23e4eab3ae36 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017828 Jul 20 15:24:50.458323 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 24/46] 10.222.0.78 () {60 vars in 1210 bytes} [Wed Jul 20 15:24:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:24:50.468959 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-50920845-45db-4a3f-b359-08ce361f0108 admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:50.476802 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.wsgi [None req-50920845-45db-4a3f-b359-08ce361f0108 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 15:24:50.478345 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-50920845-45db-4a3f-b359-08ce361f0108 admin admin] Request method failure captured: Jul 20 15:24:50.478345 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 15:24:50.478345 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: Accept: application/json Jul 20 15:24:50.478345 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: Accept-Encoding: gzip, deflate Jul 20 15:24:50.478345 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: Connection: keep-alive Jul 20 15:24:50.478345 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: Content-Length: 0 Jul 20 15:24:50.478345 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: Host: 10.222.0.78 Jul 20 15:24:50.478345 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: Openstack-Api-Version: compute 2.90 Jul 20 15:24:50.478345 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: Openstack-System-Scope: None Jul 20 15:24:50.478345 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: User-Agent: python-novaclient Jul 20 15:24:50.478345 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Auth-Token: gAAAAABi2B5B0-E9tFbzKmtgp571fim3f8Dtlz6UGsz1NpyqNLYTL30KAf9ejCyLZRyorkwb4uYl7gwr8rLLf09p9Sj6_9ZwQ_MEikYLq9biuHDs9N9U3g1l5yLw1SGoTOpnz_lC4mfWH_c3d2klPf0HRgIp2sNgIoacwGHWvoR-cmyddY8bsQQ Jul 20 15:24:50.478345 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Domain-Id: None Jul 20 15:24:50.478345 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Domain-Name: None Jul 20 15:24:50.478345 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Identity-Status: Confirmed Jul 20 15:24:50.478345 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Is-Admin-Project: True Jul 20 15:24:50.478345 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 15:24:50.478345 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Project-Domain-Id: default Jul 20 15:24:50.478345 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Project-Domain-Name: Default Jul 20 15:24:50.478345 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Project-Id: effa579779b9494f8b1dd5831edaae25 Jul 20 15:24:50.478345 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Project-Name: admin Jul 20 15:24:50.478345 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Role: admin,member,reader Jul 20 15:24:50.478345 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Roles: admin,member,reader Jul 20 15:24:50.479723 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/effa579779b9494f8b1dd5831edaae25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/effa579779b9494f8b1dd5831edaae25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_effa579779b9494f8b1dd5831edaae25", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/effa579779b9494f8b1dd5831edaae25"}]}] Jul 20 15:24:50.479723 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Tenant: admin Jul 20 15:24:50.479723 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Tenant-Id: effa579779b9494f8b1dd5831edaae25 Jul 20 15:24:50.479723 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Tenant-Name: admin Jul 20 15:24:50.479723 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-User: admin Jul 20 15:24:50.479723 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-User-Domain-Id: default Jul 20 15:24:50.479723 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-User-Domain-Name: Default Jul 20 15:24:50.479723 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-User-Id: 6049ef02a0334b599d9582b3c2aa2ebf Jul 20 15:24:50.479723 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-User-Name: admin Jul 20 15:24:50.479723 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: method: > Jul 20 15:24:50.479723 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: exception: Flavor 84 could not be found. Jul 20 15:24:50.479723 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: action_args: {'id': '84'} Jul 20 15:24:50.479723 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:24:50.479723 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:24:50.481784 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 15:24:50.481784 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 15:24:50.481784 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 15:24:50.481784 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 15:24:50.481784 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 15:24:50.481784 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 15:24:50.481784 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 15:24:50.481784 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 15:24:50.481784 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 15:24:50.481784 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:24:50.481784 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 15:24:50.481784 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 15:24:50.481784 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 15:24:50.481784 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Jul 20 15:24:50.481784 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:24:50.481784 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Jul 20 15:24:50.481784 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:24:50.481784 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:24:50.481784 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:24:50.483207 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:24:50.483207 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:24:50.483207 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:24:50.483207 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:24:50.483207 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 15:24:50.483207 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:24:50.483207 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 15:24:50.483207 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Jul 20 15:24:50.483207 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:24:50.483207 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Jul 20 15:24:50.483207 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:24:50.483207 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:24:50.483207 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:24:50.483207 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:24:50.483207 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:24:50.483207 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 15:24:50.483207 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Jul 20 15:24:50.483207 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-50920845-45db-4a3f-b359-08ce361f0108 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:24:50.484251 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-50920845-45db-4a3f-b359-08ce361f0108 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014244 Jul 20 15:24:50.484251 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 23/47] 10.222.0.78 () {60 vars in 1190 bytes} [Wed Jul 20 15:24:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 15:24:51.459000 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-f4d0c522-a696-421e-91cb-23e4eab3ae36 admin admin] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:51.460010 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-f4d0c522-a696-421e-91cb-23e4eab3ae36 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Jul 20 15:24:51.460408 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 25/48] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Jul 20 15:24:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:24:52.026729 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-38e71f5d-7c31-4f7d-933d-f6002de65c42 admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:52.032523 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.wsgi [None req-38e71f5d-7c31-4f7d-933d-f6002de65c42 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 15:24:52.034031 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-38e71f5d-7c31-4f7d-933d-f6002de65c42 admin admin] Request method failure captured: Jul 20 15:24:52.034031 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 15:24:52.034031 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: Accept: application/json Jul 20 15:24:52.034031 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: Accept-Encoding: gzip, deflate Jul 20 15:24:52.034031 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: Connection: keep-alive Jul 20 15:24:52.034031 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: Content-Length: 0 Jul 20 15:24:52.034031 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: Host: 10.222.0.78 Jul 20 15:24:52.034031 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: Openstack-Api-Version: compute 2.90 Jul 20 15:24:52.034031 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: Openstack-System-Scope: None Jul 20 15:24:52.034031 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: User-Agent: python-novaclient Jul 20 15:24:52.034031 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Auth-Token: gAAAAABi2B5DxHDBQ-uo7bX2LTwR0NWN6dFfLOucdyaXgDEbh8yXaaZVlSP4WgdCEM_-v_c1lE99XyZ4zKSdltsfbBIQcUEp5HFaJq6FN3t-HDmHBseyG4SW_FloNx1jMvk13z0I9_Ij5GCs-Gk409rbumd6m3HmHJ74kjSnxc0saKuALT371_0 Jul 20 15:24:52.034031 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Domain-Id: None Jul 20 15:24:52.034031 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Domain-Name: None Jul 20 15:24:52.034031 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Identity-Status: Confirmed Jul 20 15:24:52.034031 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Is-Admin-Project: True Jul 20 15:24:52.034031 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 15:24:52.034031 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Project-Domain-Id: default Jul 20 15:24:52.034031 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Project-Domain-Name: Default Jul 20 15:24:52.034031 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Project-Id: effa579779b9494f8b1dd5831edaae25 Jul 20 15:24:52.034031 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Project-Name: admin Jul 20 15:24:52.034031 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Role: admin,member,reader Jul 20 15:24:52.034031 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Roles: admin,member,reader Jul 20 15:24:52.035599 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/effa579779b9494f8b1dd5831edaae25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/effa579779b9494f8b1dd5831edaae25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_effa579779b9494f8b1dd5831edaae25", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/effa579779b9494f8b1dd5831edaae25"}]}] Jul 20 15:24:52.035599 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Tenant: admin Jul 20 15:24:52.035599 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Tenant-Id: effa579779b9494f8b1dd5831edaae25 Jul 20 15:24:52.035599 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-Tenant-Name: admin Jul 20 15:24:52.035599 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-User: admin Jul 20 15:24:52.035599 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-User-Domain-Id: default Jul 20 15:24:52.035599 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-User-Domain-Name: Default Jul 20 15:24:52.035599 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-User-Id: 6049ef02a0334b599d9582b3c2aa2ebf Jul 20 15:24:52.035599 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: X-User-Name: admin Jul 20 15:24:52.035599 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: method: > Jul 20 15:24:52.035599 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: exception: Flavor 451 could not be found. Jul 20 15:24:52.035599 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: action_args: {'id': '451'} Jul 20 15:24:52.035599 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:24:52.035599 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:24:52.036510 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 15:24:52.036510 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 15:24:52.036510 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 15:24:52.036510 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 15:24:52.036510 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 15:24:52.036510 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 15:24:52.036510 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 15:24:52.036510 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 15:24:52.036510 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 15:24:52.036510 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:24:52.036510 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 15:24:52.036510 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 15:24:52.036510 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 15:24:52.036510 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Jul 20 15:24:52.036510 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:24:52.036510 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Jul 20 15:24:52.036510 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:24:52.036510 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:24:52.036510 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:24:52.037609 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:24:52.037609 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:24:52.037609 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:24:52.037609 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:24:52.037609 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 15:24:52.037609 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:24:52.037609 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 15:24:52.037609 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Jul 20 15:24:52.037609 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:24:52.037609 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Jul 20 15:24:52.037609 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:24:52.037609 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:24:52.037609 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:24:52.037609 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:24:52.037609 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:24:52.037609 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 15:24:52.037609 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: ERROR nova.api.openstack.wsgi Jul 20 15:24:52.037609 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-38e71f5d-7c31-4f7d-933d-f6002de65c42 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103761) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:24:52.038676 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-38e71f5d-7c31-4f7d-933d-f6002de65c42 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.435484 Jul 20 15:24:52.038676 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 24/49] 10.222.0.78 () {60 vars in 1193 bytes} [Wed Jul 20 15:24:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 437 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 20 15:24:52.047547 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-c7f7714f-2abe-4319-96e9-1a0da04a5eeb admin admin] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:52.061874 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-c7f7714f-2abe-4319-96e9-1a0da04a5eeb admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017893 Jul 20 15:24:52.062445 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 26/50] 10.222.0.78 () {60 vars in 1210 bytes} [Wed Jul 20 15:24:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:24:52.072770 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-57376984-dbd2-4eb2-bc05-0cf000817b9f admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:52.088049 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-57376984-dbd2-4eb2-bc05-0cf000817b9f admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018680 Jul 20 15:24:52.088632 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 25/51] 10.222.0.78 () {60 vars in 1210 bytes} [Wed Jul 20 15:24:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:24:52.099010 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-2af68e72-396c-4e4c-9e7c-8b07920fd50b admin admin] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:52.104390 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.wsgi [None req-2af68e72-396c-4e4c-9e7c-8b07920fd50b admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 15:24:52.105877 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-2af68e72-396c-4e4c-9e7c-8b07920fd50b admin admin] Request method failure captured: Jul 20 15:24:52.105877 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 15:24:52.105877 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: Accept: application/json Jul 20 15:24:52.105877 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: Accept-Encoding: gzip, deflate Jul 20 15:24:52.105877 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: Connection: keep-alive Jul 20 15:24:52.105877 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: Content-Length: 0 Jul 20 15:24:52.105877 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: Host: 10.222.0.78 Jul 20 15:24:52.105877 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: Openstack-Api-Version: compute 2.90 Jul 20 15:24:52.105877 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: Openstack-System-Scope: None Jul 20 15:24:52.105877 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: User-Agent: python-novaclient Jul 20 15:24:52.105877 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Auth-Token: gAAAAABi2B5DxHDBQ-uo7bX2LTwR0NWN6dFfLOucdyaXgDEbh8yXaaZVlSP4WgdCEM_-v_c1lE99XyZ4zKSdltsfbBIQcUEp5HFaJq6FN3t-HDmHBseyG4SW_FloNx1jMvk13z0I9_Ij5GCs-Gk409rbumd6m3HmHJ74kjSnxc0saKuALT371_0 Jul 20 15:24:52.105877 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Domain-Id: None Jul 20 15:24:52.105877 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Domain-Name: None Jul 20 15:24:52.105877 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Identity-Status: Confirmed Jul 20 15:24:52.105877 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Is-Admin-Project: True Jul 20 15:24:52.105877 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 15:24:52.105877 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Project-Domain-Id: default Jul 20 15:24:52.105877 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Project-Domain-Name: Default Jul 20 15:24:52.105877 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Project-Id: effa579779b9494f8b1dd5831edaae25 Jul 20 15:24:52.105877 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Project-Name: admin Jul 20 15:24:52.105877 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Role: admin,member,reader Jul 20 15:24:52.105877 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Roles: admin,member,reader Jul 20 15:24:52.107690 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/effa579779b9494f8b1dd5831edaae25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/effa579779b9494f8b1dd5831edaae25"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_effa579779b9494f8b1dd5831edaae25", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/effa579779b9494f8b1dd5831edaae25"}]}] Jul 20 15:24:52.107690 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Tenant: admin Jul 20 15:24:52.107690 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Tenant-Id: effa579779b9494f8b1dd5831edaae25 Jul 20 15:24:52.107690 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-Tenant-Name: admin Jul 20 15:24:52.107690 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-User: admin Jul 20 15:24:52.107690 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-User-Domain-Id: default Jul 20 15:24:52.107690 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-User-Domain-Name: Default Jul 20 15:24:52.107690 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-User-Id: 6049ef02a0334b599d9582b3c2aa2ebf Jul 20 15:24:52.107690 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: X-User-Name: admin Jul 20 15:24:52.107690 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: method: > Jul 20 15:24:52.107690 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: exception: Flavor 451 could not be found. Jul 20 15:24:52.107690 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: action_args: {'id': '451'} Jul 20 15:24:52.107690 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:24:52.107690 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:24:52.108834 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 15:24:52.108834 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 15:24:52.108834 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 15:24:52.108834 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 15:24:52.108834 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 15:24:52.108834 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 15:24:52.108834 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 15:24:52.108834 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 15:24:52.108834 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 15:24:52.108834 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:24:52.108834 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 15:24:52.108834 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 15:24:52.108834 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 15:24:52.108834 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Jul 20 15:24:52.108834 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:24:52.108834 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Jul 20 15:24:52.108834 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:24:52.108834 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:24:52.108834 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:24:52.110348 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:24:52.110348 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:24:52.110348 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:24:52.110348 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:24:52.110348 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 15:24:52.110348 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:24:52.110348 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 15:24:52.110348 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Jul 20 15:24:52.110348 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:24:52.110348 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Jul 20 15:24:52.110348 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:24:52.110348 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:24:52.110348 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:24:52.110348 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:24:52.110348 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:24:52.110348 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 15:24:52.110348 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: ERROR nova.api.openstack.wsgi Jul 20 15:24:52.110348 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-2af68e72-396c-4e4c-9e7c-8b07920fd50b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103760) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:24:52.111432 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-2af68e72-396c-4e4c-9e7c-8b07920fd50b admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012482 Jul 20 15:24:52.111432 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 27/52] 10.222.0.78 () {60 vars in 1193 bytes} [Wed Jul 20 15:24:52 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 15:24:53.098928 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-57376984-dbd2-4eb2-bc05-0cf000817b9f admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:53.100515 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-57376984-dbd2-4eb2-bc05-0cf000817b9f admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002056 Jul 20 15:24:53.101009 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 26/53] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Jul 20 15:24:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:24:53.662780 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-0ec8b3a6-8653-44a9-ae00-4d3853350309 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:24:53.776520 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-0ec8b3a6-8653-44a9-ae00-4d3853350309 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.535170 Jul 20 15:24:53.777069 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 28/54] 10.222.0.78 () {64 vars in 1235 bytes} [Wed Jul 20 15:24:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 15:24:54.762343 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-57376984-dbd2-4eb2-bc05-0cf000817b9f admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:54.763396 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-57376984-dbd2-4eb2-bc05-0cf000817b9f admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Jul 20 15:24:54.763789 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 27/55] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Jul 20 15:24:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:24:55.303114 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-9e3b5da1-2cab-4d64-8f4a-289265e931c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:24:55.387895 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-9e3b5da1-2cab-4d64-8f4a-289265e931c1 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.486703 Jul 20 15:24:55.388454 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 29/56] 10.222.0.78 () {64 vars in 1235 bytes} [Wed Jul 20 15:24:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 15:24:56.369111 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-57376984-dbd2-4eb2-bc05-0cf000817b9f admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:56.370108 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-57376984-dbd2-4eb2-bc05-0cf000817b9f admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jul 20 15:24:56.370530 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 28/57] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Jul 20 15:24:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:24:56.912351 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-5987413a-b64e-4602-b2e2-a39dfaec9fa6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:24:56.998706 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-5987413a-b64e-4602-b2e2-a39dfaec9fa6 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.491781 Jul 20 15:24:56.999337 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 30/58] 10.222.0.78 () {64 vars in 1235 bytes} [Wed Jul 20 15:24:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 15:24:58.005613 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-57376984-dbd2-4eb2-bc05-0cf000817b9f admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:58.006749 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-57376984-dbd2-4eb2-bc05-0cf000817b9f admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Jul 20 15:24:58.007153 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 29/59] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Jul 20 15:24:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:24:58.574496 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-4b2f61a3-c268-4a21-bdb5-4b65f966ad5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:24:58.766175 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-4b2f61a3-c268-4a21-bdb5-4b65f966ad5f admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.620968 Jul 20 15:24:58.766764 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 31/60] 10.222.0.78 () {64 vars in 1235 bytes} [Wed Jul 20 15:24:58 2022] POST /compute/v2.1/flavors => generated 409 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 15:24:59.768910 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-57376984-dbd2-4eb2-bc05-0cf000817b9f admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:24:59.770359 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-57376984-dbd2-4eb2-bc05-0cf000817b9f admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002212 Jul 20 15:24:59.771265 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 30/61] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Jul 20 15:24:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:25:00.359330 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-cff055f8-5a8d-479f-a9cb-c656a7607170 admin admin] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:25:00.379249 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-cff055f8-5a8d-479f-a9cb-c656a7607170 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.468394 Jul 20 15:25:00.379803 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 32/62] 10.222.0.78 () {60 vars in 1202 bytes} [Wed Jul 20 15:24:59 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:25:54.592157 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-57376984-dbd2-4eb2-bc05-0cf000817b9f admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:25:54.593162 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-57376984-dbd2-4eb2-bc05-0cf000817b9f admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 20 15:25:54.593565 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 31/63] 10.222.0.78 () {54 vars in 930 bytes} [Wed Jul 20 15:25:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:25:54.604907 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG dbcounter [-] [103760] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:25:55.035164 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-bdf6c637-7f14-4223-bcd7-e8241d2135e7 admin admin] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:25:55.054862 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-bdf6c637-7f14-4223-bcd7-e8241d2135e7 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.454660 Jul 20 15:25:55.055404 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 33/64] 10.222.0.78 () {60 vars in 1291 bytes} [Wed Jul 20 15:25:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:25:55.077287 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG dbcounter [-] [103761] Writing DB stats nova_api:SELECT=14 {{(pid=103761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:25:55.084776 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-88876a82-2a71-4175-8fbb-cd233e89968e admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:25:55.103441 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-88876a82-2a71-4175-8fbb-cd233e89968e admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.022549 Jul 20 15:25:55.103441 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 32/65] 10.222.0.78 () {60 vars in 1282 bytes} [Wed Jul 20 15:25:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:25:55.111721 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-262fe2dd-610a-44da-ba1a-84cc077dd790 admin admin] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:25:55.119771 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-262fe2dd-610a-44da-ba1a-84cc077dd790 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011738 Jul 20 15:25:55.120330 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 34/66] 10.222.0.78 () {60 vars in 1285 bytes} [Wed Jul 20 15:25:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:25:55.132455 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-4dc87728-c8d4-4edd-bf78-c30eb9c2297d admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:25:55.143939 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-4dc87728-c8d4-4edd-bf78-c30eb9c2297d admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014376 Jul 20 15:25:55.145987 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 33/67] 10.222.0.78 () {60 vars in 1285 bytes} [Wed Jul 20 15:25:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:25:55.157101 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-b6d5af66-e3b8-4d0d-9c51-31dad236cf72 admin admin] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:25:55.165366 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-b6d5af66-e3b8-4d0d-9c51-31dad236cf72 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011932 Jul 20 15:25:55.165899 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 35/68] 10.222.0.78 () {60 vars in 1282 bytes} [Wed Jul 20 15:25:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:29:32.857103 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-4dc87728-c8d4-4edd-bf78-c30eb9c2297d admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:29:32.858649 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-4dc87728-c8d4-4edd-bf78-c30eb9c2297d admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001940 Jul 20 15:29:32.859050 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 34/69] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Jul 20 15:29:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:29:33.002039 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG dbcounter [-] [103760] Writing DB stats nova_api:SELECT=6 {{(pid=103760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:33.207967 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-6be577df-080e-4212-bf22-3afae945d3c5 admin admin] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:29:33.210233 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:29:33.210233 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: warnings.warn(msg) Jul 20 15:29:33.212894 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_concurrency.lockutils [None req-6be577df-080e-4212-bf22-3afae945d3c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:29:33.213654 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_concurrency.lockutils [None req-6be577df-080e-4212-bf22-3afae945d3c5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:29:33.215123 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_concurrency.lockutils [None req-6be577df-080e-4212-bf22-3afae945d3c5 admin admin] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:29:33.215822 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_concurrency.lockutils [None req-6be577df-080e-4212-bf22-3afae945d3c5 admin admin] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:29:33.281247 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-6be577df-080e-4212-bf22-3afae945d3c5 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.280268 Jul 20 15:29:33.283191 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 36/70] 10.222.0.78 () {60 vars in 1193 bytes} [Wed Jul 20 15:29:32 2022] GET /compute/v2.1/os-services => generated 794 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 15:29:34.172505 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-4dc87728-c8d4-4edd-bf78-c30eb9c2297d admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:29:34.174083 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-4dc87728-c8d4-4edd-bf78-c30eb9c2297d admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001666 Jul 20 15:29:34.174721 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 35/71] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Jul 20 15:29:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:29:34.412608 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-87591ebc-2a93-4b1a-9db6-30b781f31f2e admin admin] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:29:34.414170 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:29:34.414170 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: warnings.warn(msg) Jul 20 15:29:34.415832 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_concurrency.lockutils [None req-87591ebc-2a93-4b1a-9db6-30b781f31f2e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:29:34.416380 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_concurrency.lockutils [None req-87591ebc-2a93-4b1a-9db6-30b781f31f2e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:29:34.417284 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_concurrency.lockutils [None req-87591ebc-2a93-4b1a-9db6-30b781f31f2e admin admin] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:29:34.417817 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_concurrency.lockutils [None req-87591ebc-2a93-4b1a-9db6-30b781f31f2e admin admin] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:29:34.439843 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-87591ebc-2a93-4b1a-9db6-30b781f31f2e admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.092775 Jul 20 15:29:34.440433 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 37/72] 10.222.0.78 () {60 vars in 1193 bytes} [Wed Jul 20 15:29:34 2022] GET /compute/v2.1/os-services => generated 794 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 15:29:45.820872 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-4dc87728-c8d4-4edd-bf78-c30eb9c2297d admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:29:45.821894 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-4dc87728-c8d4-4edd-bf78-c30eb9c2297d admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 20 15:29:45.822337 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 36/73] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Jul 20 15:29:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:29:45.972020 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG dbcounter [-] [103760] Writing DB stats nova_cell0:SELECT=4 {{(pid=103760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:45.972809 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG dbcounter [-] [103760] Writing DB stats nova_cell1:SELECT=4 {{(pid=103760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:45.973763 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG dbcounter [-] [103760] Writing DB stats nova_api:SELECT=8 {{(pid=103760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:29:46.032266 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-7965ae5f-a3ef-4241-833d-1ebff68b84a2 admin admin] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:29:46.033627 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:29:46.033627 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: warnings.warn(msg) Jul 20 15:29:46.035662 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_concurrency.lockutils [None req-7965ae5f-a3ef-4241-833d-1ebff68b84a2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:29:46.036169 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_concurrency.lockutils [None req-7965ae5f-a3ef-4241-833d-1ebff68b84a2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:29:46.037035 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_concurrency.lockutils [None req-7965ae5f-a3ef-4241-833d-1ebff68b84a2 admin admin] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:29:46.037513 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_concurrency.lockutils [None req-7965ae5f-a3ef-4241-833d-1ebff68b84a2 admin admin] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:29:46.068188 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-7965ae5f-a3ef-4241-833d-1ebff68b84a2 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.101597 Jul 20 15:29:46.068781 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 38/74] 10.222.0.78 () {60 vars in 1193 bytes} [Wed Jul 20 15:29:45 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:29:47.043610 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: DEBUG nova.api.openstack.wsgi [None req-4dc87728-c8d4-4edd-bf78-c30eb9c2297d admin admin] Calling method '>' {{(pid=103761) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:29:47.046071 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: INFO nova.api.openstack.requestlog [None req-4dc87728-c8d4-4edd-bf78-c30eb9c2297d admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003224 Jul 20 15:29:47.046907 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: [pid: 103761|app: 0|req: 37/75] 10.222.0.78 () {56 vars in 1074 bytes} [Wed Jul 20 15:29:47 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:29:47.305835 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG nova.api.openstack.wsgi [None req-d2486a85-329e-41d6-b853-5478fc3830eb admin admin] Calling method '>' {{(pid=103760) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:29:47.307068 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 15:29:47.307068 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: warnings.warn(msg) Jul 20 15:29:47.308468 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_concurrency.lockutils [None req-d2486a85-329e-41d6-b853-5478fc3830eb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:29:47.308913 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_concurrency.lockutils [None req-d2486a85-329e-41d6-b853-5478fc3830eb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:29:47.309721 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_concurrency.lockutils [None req-d2486a85-329e-41d6-b853-5478fc3830eb admin admin] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:29:47.310721 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: DEBUG oslo_concurrency.lockutils [None req-d2486a85-329e-41d6-b853-5478fc3830eb admin admin] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103760) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:29:47.333803 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: INFO nova.api.openstack.requestlog [None req-d2486a85-329e-41d6-b853-5478fc3830eb admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.101703 Jul 20 15:29:47.334498 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: [pid: 103760|app: 0|req: 39/76] 10.222.0.78 () {60 vars in 1193 bytes} [Wed Jul 20 15:29:47 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:30:45.056636 dv-cinder-819149-12-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 20 15:30:45.058658 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: Wed Jul 20 15:30:45 2022 - graceful shutdown triggered... Jul 20 15:30:45.059406 dv-cinder-819149-12-iscsi devstack@n-api.service[103760]: Gracefully killing worker 1 (pid: 103760)... Jul 20 15:30:45.059961 dv-cinder-819149-12-iscsi devstack@n-api.service[103761]: Gracefully killing worker 2 (pid: 103761)... Jul 20 15:30:46.058836 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: worker 1 buried after 1 seconds Jul 20 15:30:46.058836 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: worker 2 buried after 1 seconds Jul 20 15:30:46.058836 dv-cinder-819149-12-iscsi devstack@n-api.service[103759]: goodbye to uWSGI. Jul 20 15:30:46.060450 dv-cinder-819149-12-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 20 15:30:46.060998 dv-cinder-819149-12-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 20 15:30:46.063828 dv-cinder-819149-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 15:30:46.073605 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 15:30:46.077526 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 15:30:46 2022] *** Jul 20 15:30:46.077526 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 15:30:46.077526 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 15:30:46.077526 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: nodename: dv-cinder-819149-12-iscsi Jul 20 15:30:46.077526 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: machine: x86_64 Jul 20 15:30:46.077526 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: clock source: unix Jul 20 15:30:46.077526 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: pcre jit disabled Jul 20 15:30:46.077526 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: detected number of CPU cores: 4 Jul 20 15:30:46.077526 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: current working directory: / Jul 20 15:30:46.077526 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: detected binary path: /usr/bin/uwsgi-core Jul 20 15:30:46.077526 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: your processes number limit is 47680 Jul 20 15:30:46.078660 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: your memory page size is 4096 bytes Jul 20 15:30:46.078660 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: detected max file descriptor number: 2048 Jul 20 15:30:46.078660 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: lock engine: pthread robust mutexes Jul 20 15:30:46.078660 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: thunder lock: enabled Jul 20 15:30:46.078660 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 15:30:46.078660 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 15:30:46.128220 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: Python main interpreter initialized at 0x55a36fae09c0 Jul 20 15:30:46.128220 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: python threads support enabled Jul 20 15:30:46.128220 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: your server socket listen backlog is limited to 100 connections Jul 20 15:30:46.128220 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: your mercy for graceful operations on workers is 90 seconds Jul 20 15:30:46.128663 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 15:30:46.128736 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: *** Operational MODE: preforking *** Jul 20 15:30:46.129016 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: *** uWSGI is running in multiple interpreter mode *** Jul 20 15:30:46.129016 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: spawned uWSGI master process (pid: 124703) Jul 20 15:30:46.129216 dv-cinder-819149-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 15:30:46.131612 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: spawned uWSGI worker 1 (pid: 124711, cores: 1) Jul 20 15:30:46.132152 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: spawned uWSGI worker 2 (pid: 124712, cores: 1) Jul 20 15:30:46.132535 dv-cinder-819149-12-iscsi devstack@n-api.service[124703]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 15:30:46.879826 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 15:30:46.898315 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 15:30:48.110979 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 15:30:48.110979 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: from cryptography.utils import int_from_bytes Jul 20 15:30:48.112078 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 15:30:48.112078 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: from cryptography.utils import int_from_bytes Jul 20 15:30:48.189802 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 15:30:48.189802 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: from cryptography.utils import int_from_bytes Jul 20 15:30:48.190791 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 15:30:48.190791 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: from cryptography.utils import int_from_bytes Jul 20 15:30:50.726895 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 15:30:50.728041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 15:30:50.728041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 15:30:50.728399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 15:30:50.728399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 15:30:50.728750 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.729068 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.729405 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.730217 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.730418 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.730703 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.730966 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.731292 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.731627 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.731890 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.732207 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.732545 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-12-iscsi {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.732878 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.733220 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.733730 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.733956 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.734389 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.734742 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.735272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.735882 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.736371 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.736689 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.737045 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.737407 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.737747 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.738067 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.738422 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.738765 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.739097 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.739417 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.739826 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-12-iscsi {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.740164 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.740489 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.740790 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.741211 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.741528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.741866 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.742387 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.742878 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.743327 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.743667 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.743997 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.744326 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.744653 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.744964 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.745277 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.745625 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.745953 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.746292 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.746620 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.746875 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.747188 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.747518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.747843 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.748170 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.748427 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.748684 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.749009 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.749335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.749643 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.750039 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.750304 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.750620 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.750910 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.751222 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.751532 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.751844 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.752168 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.752488 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.752812 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.753130 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.753456 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.753859 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.754116 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.754453 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.754825 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.755150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.755464 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.755787 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.756114 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.756428 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.756738 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.757049 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.757369 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.757710 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.758023 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.758337 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.758602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.758914 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.759262 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.759576 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.759889 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.760233 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.760525 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.760835 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.761700 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.761967 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.762296 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.762617 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.762930 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.763294 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.763550 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.763865 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.764615 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.764615 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.765388 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.765388 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.765388 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.769866 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.769866 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.769866 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.769866 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.769866 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.769866 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.769866 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.769866 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.772286 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.772286 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.772286 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.772286 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.772286 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.772286 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.772286 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.772286 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.773797 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.773797 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.773797 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.773797 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.773797 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.773797 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.773797 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.773797 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.775171 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.775171 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.775171 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.776168 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.777319 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:50.777712 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.778215 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.778753 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.779219 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.779714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.780207 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.780680 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.781119 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.781586 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.782079 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.782607 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.783161 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.783761 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.784345 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.784916 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.785433 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.785939 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.786495 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.787104 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.787666 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.788158 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.788734 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.789314 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.789881 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.790463 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.791076 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.791676 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.792164 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.792654 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.793102 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.793569 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.794035 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.794516 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.794985 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.795424 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.795869 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.796345 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.796786 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.797252 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.797841 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.798372 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.798850 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.799419 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.799998 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.800777 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.801281 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.801878 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.802504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.803090 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.803671 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.804263 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.804838 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.806513 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.806513 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.806828 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.807263 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.808362 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.808955 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.809540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.810136 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.810799 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.811436 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.811962 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.812536 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.813156 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.813524 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.813922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.814456 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.814873 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.815270 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.815643 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.816166 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.816733 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.817252 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.817634 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.818141 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.818595 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.818948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.819284 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.819620 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.819976 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.820326 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.820754 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.821165 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.821578 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.821840 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.822159 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.822529 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.822850 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.823171 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.824110 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.824528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.824848 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.825186 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.825610 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.825998 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.826515 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.826685 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.827012 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.827383 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.827701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.828024 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.828607 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.829167 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.829747 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.830351 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.830707 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.831053 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.831386 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.831715 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.832036 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.832361 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.832920 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.833508 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.834134 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.834751 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.835364 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.835792 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.836185 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.836745 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.837022 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.837264 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.837770 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.838396 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.839024 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.839412 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.839887 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.840224 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.840592 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.840898 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.841236 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.841597 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.842208 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.842208 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.842719 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.842954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.843346 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.843630 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.844169 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.845014 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.845593 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.846082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.846590 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.847110 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.847506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.847958 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.848331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.851653 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.851653 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.851653 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.851653 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.851653 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.851653 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.851653 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.851653 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.853655 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.853655 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.853655 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.853655 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.853655 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.853655 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.854981 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.854981 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.854981 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.855615 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.855615 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.856222 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.856464 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.856694 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.857173 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.857458 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.857838 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.858199 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.858673 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.859107 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.859475 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.859809 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.860153 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.860609 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.861036 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.861580 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.862115 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.862742 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.863304 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.868602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.868602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.868602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.868602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.868602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.868602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.868602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.868602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.871476 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.871476 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.871476 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.871476 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.872037 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.872196 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.872747 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.873382 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.873986 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.874627 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.875366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.875881 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.876295 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.878157 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.878157 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.878157 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.878157 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.878157 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.879729 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.879729 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.879729 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.879729 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.879729 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.881267 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.881267 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.881267 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.881987 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.882245 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.882781 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.883139 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.883511 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.883867 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.884188 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.885182 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.885182 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.885182 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.885912 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.885912 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.887116 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.887116 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.887569 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.887799 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.888076 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.888396 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.888713 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.889028 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.889350 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.889702 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.890016 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.890352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.891229 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.891229 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.891711 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.891711 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.892174 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.892714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.893328 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.893929 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.894349 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.894709 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.895435 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.895435 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.896073 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.896073 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.896535 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.896780 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.897013 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.897258 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.897494 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.897816 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.898137 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.898486 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.898829 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.899174 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.899489 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.899805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.900126 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.900498 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.900845 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.901564 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.901564 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.902036 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.902317 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.902581 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.902867 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.903270 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.903538 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.903808 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.904126 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.904440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.904757 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.905524 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.905524 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.905980 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.905980 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.906407 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.906681 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.907047 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.907404 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.907715 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.908090 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.908494 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.908744 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.909038 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.909363 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.909684 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.910004 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.910336 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.910667 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.910986 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.911309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.911708 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.911915 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.912245 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.912574 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.912902 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.913236 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.913652 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.913935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.914196 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.914495 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.914882 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.915203 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.915907 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.915907 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.916477 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.916895 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.917245 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.917637 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.918085 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.918505 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.919069 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.919611 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.920090 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.920681 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.921239 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.921980 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.921980 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.922554 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.922794 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.923052 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.923753 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.924309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.924846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.925317 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.926059 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.926303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.926759 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.927227 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.927718 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.928498 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.929017 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.929479 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.929943 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.930541 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.931105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.931689 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.932129 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.932532 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.933538 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.933979 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.934597 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.935199 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.936256 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.936557 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.937107 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.937636 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.938219 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.938621 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.938958 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.939302 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.939630 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.940061 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.940573 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.940916 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.941247 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.941590 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.941992 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.942605 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.942605 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.943051 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.943293 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.943564 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.943895 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.944264 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.944653 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.944988 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.945333 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.945631 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.945968 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.946613 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.946613 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.947237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.947467 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.947685 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.948034 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.948370 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.949261 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.949622 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.949968 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.950654 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.950654 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.951147 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.951373 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.951607 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.952072 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.952351 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.952805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.953043 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.953270 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.953514 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.953821 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.954134 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.954552 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.954819 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.955141 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.955474 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.955905 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.956165 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.956838 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.956838 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.957463 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.957463 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.957990 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.958218 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.958512 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.958756 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.959035 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.959356 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.959701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.960034 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.960353 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.960952 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.960952 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.961437 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.961680 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.961920 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.962326 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.962591 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.963020 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.963361 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.963581 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.963885 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.964245 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.964610 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.964939 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.965269 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.965609 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.965953 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.966340 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.967042 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.967042 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.967653 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.967653 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.968116 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.968354 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.968599 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.968839 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.969158 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.969749 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.970107 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.970755 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.971205 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.971621 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.972942 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.972942 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.972942 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.972942 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.972942 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.974228 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.974228 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.974228 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.975111 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.975111 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.975111 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.975771 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.975771 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.976236 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.976477 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.976872 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.977488 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.978087 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.978697 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.979289 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.979924 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.980535 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.981012 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.981746 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.982164 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.982712 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.983398 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.983932 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.984502 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.985029 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.985650 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.986315 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.986901 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.987552 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.987822 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.988178 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.988702 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.989041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.989394 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.989739 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.990081 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.990445 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.990783 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.992230 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.992230 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.992230 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.992230 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.993230 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.993230 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.993230 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.994021 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.994021 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.994021 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.994696 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.995116 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.995848 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.996178 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.996516 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.996851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.997213 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.997870 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.997870 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.998501 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.998501 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.998961 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.999224 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.999475 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:50.999704 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.000009 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.000328 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.000640 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.000958 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.001270 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.001796 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.002057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.002553 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.002553 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.003123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.003123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.003742 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.003742 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.004336 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.004336 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.004817 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.005071 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 15:30:51.005947 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.006197 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 15:30:51.006461 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.006461 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.006937 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 15:30:51.007170 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.007417 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 15:30:51.008061 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.008312 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 15:30:51.008684 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.008925 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.009178 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.009437 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.009684 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.009937 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.010198 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.010498 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.010760 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.011068 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.011809 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.013277 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.013699 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.013942 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.014383 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.014649 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.014892 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.015144 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.015389 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.015628 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.015911 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.016312 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.016312 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-12-iscsi {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.016785 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.017018 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.017257 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.017496 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.017724 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.018412 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.021748 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.022019 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.022315 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.022462 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.022625 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.022775 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.022910 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.023044 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.023177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.023310 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.023457 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.023617 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.023757 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.023896 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.024033 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.024175 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.024332 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.024462 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.024592 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.024733 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.024872 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.025003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.025150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.025280 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.025418 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.025556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.025693 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.025834 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.025977 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.026106 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.026253 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.026253 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.026604 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-12-iscsi {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.026775 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.026929 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.027089 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.027241 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.027402 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.027567 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.027717 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.027869 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.028019 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.029571 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.029788 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.030105 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.030334 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.030538 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.030762 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.030963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.031183 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.031410 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.031650 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.031801 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.031941 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.032149 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.032346 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.032346 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.032731 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.032928 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.033128 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.033325 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.033325 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.033728 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.033930 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.033930 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.033930 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.033930 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.033930 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.033930 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.033930 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.033930 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.035492 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.035492 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.035492 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.035492 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.035492 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.035492 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.036557 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.036757 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.036757 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.036757 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.036757 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.036757 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.036757 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.037896 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.038107 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.038337 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.040388 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.040388 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.040796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.041005 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.041005 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.041005 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.041563 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.041777 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.041777 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.042222 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.042522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.042522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.042522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.043083 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.043295 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.043295 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.043682 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.043881 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.044071 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.044263 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.044263 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.044647 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.044852 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.045063 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.045272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.045272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.045644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.045850 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.046052 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.046246 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.046246 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.046665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.046892 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.046892 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.047280 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.047480 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.047689 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.047900 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.047900 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.048326 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.050663 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.050897 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.051136 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.051350 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.051569 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.051795 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.052000 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.052218 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.052434 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.052637 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.052840 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.053056 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.053265 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.053474 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.053690 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.053905 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.054105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.054326 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.054544 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.054747 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.055143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.055363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.055565 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.055770 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.055960 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.055960 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.056521 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.056734 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.056933 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.057136 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.057136 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.057560 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.061041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.061290 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.061503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.061503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.061891 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.062102 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.062330 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.062551 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.062551 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.062954 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.062954 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.063331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.063526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.063736 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.063958 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.064280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.064502 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.064702 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.064893 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.065079 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.065282 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.065488 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.065703 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.065703 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.066078 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.066283 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.066496 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.066814 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.067030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.067239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.067239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.067618 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.067805 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.068003 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.068186 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.068186 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.068563 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.068767 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.068996 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.070458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.070458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.070863 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.071061 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.071276 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.071652 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.071652 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.072053 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.072246 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.072436 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.072628 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.072829 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.073040 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.073040 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.073400 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.074137 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.074370 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124712) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 15:30:51.074580 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.074580 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.074580 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.074580 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.074580 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.074580 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.074580 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.074580 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.076782 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.076782 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.076782 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.076782 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.076782 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.076782 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.076782 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.076782 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.078458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.078458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.078458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.078458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.078458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.078458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.078458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.078458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.081050 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.081050 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.081050 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.081050 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.081050 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.081050 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 15:30:51.081050 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.081050 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.082756 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.082756 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.082756 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.082756 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.082756 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.082756 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.082756 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.082756 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.085551 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.085551 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.085551 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.085551 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.085551 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.085551 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.085551 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.085551 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.087381 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.087381 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.087381 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.087381 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.087381 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.087381 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.087381 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.087381 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.106593 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.106593 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.106593 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.106593 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.106593 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.106593 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.106593 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.106593 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.108439 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.108439 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.108439 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.108439 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.108439 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.108439 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.108439 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.108439 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.112159 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.112159 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.112159 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.112159 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.112159 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.112159 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.112159 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.112159 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.114874 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.114874 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.114874 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.114874 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.114874 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.114874 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.114874 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.114874 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.116665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.116665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.116665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.116665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.116665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.116665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.116665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.116665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.119070 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.119070 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.119070 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.119070 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.119070 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.119070 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.119070 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.119070 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.122673 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.122673 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.122673 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.122673 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.122673 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.122673 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.122673 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.122673 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.125617 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.125617 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.125617 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.125617 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.125617 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.125617 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.125617 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.125617 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.127301 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.127301 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.127301 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.127301 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.127301 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.127301 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.127301 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.127301 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.128870 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.128870 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.128870 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.128870 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.128870 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.128870 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.128870 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.128870 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.130538 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.130538 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.130538 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.130538 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.130538 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.130538 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.130538 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.130538 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.133857 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.133857 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.133857 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.133857 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.133857 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.133857 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.133857 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.133857 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.135584 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.135584 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.135584 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.135584 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.135584 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.135584 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.135584 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.135584 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.138224 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.138224 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.138224 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.138224 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.138224 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.138224 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.138224 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.138224 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.139916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.139916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.139916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.139916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.139916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.139916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.139916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.139916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.141608 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.141608 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.141608 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.141608 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.141608 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.141608 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.141608 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.141608 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.144876 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.144876 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.144876 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.144876 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.144876 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.144876 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.144876 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.144876 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.145863 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.145863 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.145863 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.145863 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.145863 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.145863 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.145863 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.145863 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.147360 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.147360 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.147360 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.147360 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.147360 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.147360 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.147360 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.147360 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.148416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.148416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.148416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.148416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.148416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.148416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.148416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.148416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.149356 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.149356 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.149356 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.149356 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.149356 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.149356 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.149356 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.149356 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.150447 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.150447 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.150447 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.150447 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.150447 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.150447 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.150447 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.150447 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.151437 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.151437 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.151437 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.151437 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.151437 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.151437 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.151437 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.151437 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.153339 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.153339 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.153339 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.153339 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.153339 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.153339 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.153339 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.153339 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.154333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.154333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.154333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.154333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.154333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.154333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.154333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.154333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.155321 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.155321 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.155321 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.155321 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.155321 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.155321 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.155321 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.155321 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.156289 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.156289 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.156289 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.156289 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.156289 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.156289 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.156289 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.156289 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.157261 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.157261 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.157261 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.157261 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.157261 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.157261 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.157261 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.157261 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.158237 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.158237 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.158237 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.158237 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.158890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.158890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.159167 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.159481 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.159797 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.160112 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.160425 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.160742 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.161059 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.161372 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.161712 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.162038 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.162396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.163038 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.163038 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.163323 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.163838 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.164014 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.164235 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.164563 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.164876 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.165193 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.165504 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.165817 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.166431 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.166756 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.167065 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.167920 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.168231 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.168542 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.168855 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.169191 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.169513 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.169825 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.170126 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.170460 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.170830 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.171140 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.171514 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.171828 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.172150 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.172475 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.172816 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.173466 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.173466 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.174069 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.177386 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.177386 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.177386 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.177386 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.177386 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.177386 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.177915 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.178278 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.178881 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.179472 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.180085 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.180622 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.181178 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.181748 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.182316 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.182829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.185236 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.185236 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.185565 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.186036 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.186629 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.187030 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.187459 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.187854 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.188244 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.188637 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.189043 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.189432 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.189817 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.190201 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.190654 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.191067 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.191503 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.191964 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.192291 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.192616 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.192935 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.193259 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.193643 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.193972 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.194314 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.194734 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.195106 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.195430 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.195754 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.196365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.196365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.196803 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.197016 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.197310 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.197620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.197930 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.198240 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.198624 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.199041 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.199379 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.199803 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.200117 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.200428 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.200849 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.201160 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.201472 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.201800 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.202126 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.202476 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.202782 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.203098 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.203409 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.203738 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.204068 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.204383 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.204702 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.205036 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.205325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.205743 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.206061 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.206430 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.206844 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.207172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.207489 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.207813 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.208140 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.208453 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.208765 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.209078 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.209389 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.209700 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.210026 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.210358 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.210678 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.210993 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.211306 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.211614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.211921 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.212246 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.212556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.213188 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.213188 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.213619 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.213846 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.214133 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.214505 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.214816 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.215164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.215429 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.215740 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.216075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.216377 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.216696 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.217028 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.217357 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.217669 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.217999 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.218352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.218664 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.218985 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.219592 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.219894 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.220200 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.220509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.220820 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.221129 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.221433 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.221739 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.222044 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.222373 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.222677 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.223002 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.223304 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.223630 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.223938 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.224245 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.224546 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.224850 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.225306 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.225532 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.225818 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.226151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.226477 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.226806 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.227116 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.227443 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.227756 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.228070 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.228388 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.228704 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.229017 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.229334 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.229644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.230582 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.230904 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.231221 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.231539 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.232103 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.232433 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.232751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.233062 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.233375 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.233691 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.234008 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.234340 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.234652 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.234962 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.235266 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.235597 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.235920 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.236260 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.236592 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.236999 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.237316 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.237800 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.238240 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.239244 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.239244 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.239244 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.239244 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.240942 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.240942 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.240942 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.240942 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.240942 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.240942 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.243070 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.243070 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.243070 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.243070 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.243070 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.243070 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.244162 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.244162 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.244162 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.244693 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO dbcounter [None req-98ccfb71-9c07-48eb-83d1-8632850eecb8 None None] Registered counter for database nova_api Jul 20 15:30:51.244887 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.244887 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.244887 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.246047 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.246730 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.247059 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.247382 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.247706 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.248041 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.248351 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.248660 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.248969 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.249283 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.249589 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.249908 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.250222 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.250553 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.250873 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.251183 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.251726 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.252076 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.252392 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.252722 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.253050 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.253369 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.253676 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.254004 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.254329 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.254638 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.254958 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.255269 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.255577 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.255888 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.256202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.256697 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.256925 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.257134 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.257399 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.257729 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.258039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.258457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.258803 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.259120 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.259425 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.259730 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.260037 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.260342 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.260656 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.260991 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.261303 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.261608 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.261921 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.262223 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.262559 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.262919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.263690 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.263690 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.264089 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.264296 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.264498 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.265038 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.265038 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.265454 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.265700 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.266017 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.266766 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.267125 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.267490 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.267778 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.268108 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.268482 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.268809 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.269036 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.269368 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.269683 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.269995 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.270330 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.270623 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_db.sqlalchemy.engines [None req-98ccfb71-9c07-48eb-83d1-8632850eecb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 15:30:51.270797 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.271025 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.271228 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.271687 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.272026 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.272352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.272778 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.272984 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.273616 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.273934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.274347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.274752 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.275113 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.275438 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.275758 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.276083 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.277843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.277843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.277843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.277843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.277843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.278589 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.278589 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.278589 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.279142 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.279489 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.279817 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.280271 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.280589 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.280917 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.281245 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.281558 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.281884 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.282194 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.282553 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.282926 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.283083 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writer thread running {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 15:30:51.283340 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.283661 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.283967 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.284276 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.284590 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.284899 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.285208 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.285602 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.285848 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.286117 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.286456 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.286764 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.287070 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.287377 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.287688 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.288182 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.288492 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.288920 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.289172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.289434 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.289693 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.289957 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.290304 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.290602 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.290906 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.291268 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.291564 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.291799 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.292125 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.292981 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.293296 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.293622 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.293936 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.294280 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.294588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.294914 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.295238 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.295556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.295937 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.296190 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.296476 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.296804 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.297204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.297618 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.297870 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.298134 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.298467 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.298847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.299257 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.299502 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.299763 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.300132 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.300448 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.300759 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.301322 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.301644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.301960 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.302293 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.302637 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.302951 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.303269 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.303582 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.303897 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.304218 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.304534 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.304863 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.305192 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.305499 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.305829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.306220 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.306535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.306829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.307178 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.307510 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.307953 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.308872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.309465 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 15:30:51.309465 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124711) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 15:30:51.359546 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.context [None req-98ccfb71-9c07-48eb-83d1-8632850eecb8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),794b77f4-e750-4ef6-ba0b-862dc242f7fe(cell1) {{(pid=124712) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 15:30:51.364216 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-98ccfb71-9c07-48eb-83d1-8632850eecb8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:30:51.365966 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-98ccfb71-9c07-48eb-83d1-8632850eecb8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:30:51.367345 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-98ccfb71-9c07-48eb-83d1-8632850eecb8 None None] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:30:51.369105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-98ccfb71-9c07-48eb-83d1-8632850eecb8 None None] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:30:51.371990 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO dbcounter [None req-98ccfb71-9c07-48eb-83d1-8632850eecb8 None None] Registered counter for database nova_cell0 Jul 20 15:30:51.376962 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO dbcounter [None req-98ccfb71-9c07-48eb-83d1-8632850eecb8 None None] Registered counter for database nova_cell1 Jul 20 15:30:51.385870 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_db.sqlalchemy.engines [None req-98ccfb71-9c07-48eb-83d1-8632850eecb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 15:30:51.389256 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_db.sqlalchemy.engines [None req-98ccfb71-9c07-48eb-83d1-8632850eecb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 15:30:51.397413 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writer thread running {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 15:30:51.397756 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writer thread running {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 15:30:51.462900 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO dbcounter [None req-217b75c6-77c3-4377-bfa1-14d38f55b7a6 None None] Registered counter for database nova_api Jul 20 15:30:51.483546 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_db.sqlalchemy.engines [None req-217b75c6-77c3-4377-bfa1-14d38f55b7a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 15:30:51.492127 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writer thread running {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 15:30:51.549127 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO dbcounter [None req-98ccfb71-9c07-48eb-83d1-8632850eecb8 None None] Registered counter for database nova_cell0 Jul 20 15:30:51.549743 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.context [None req-217b75c6-77c3-4377-bfa1-14d38f55b7a6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),794b77f4-e750-4ef6-ba0b-862dc242f7fe(cell1) {{(pid=124711) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 15:30:51.553958 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-217b75c6-77c3-4377-bfa1-14d38f55b7a6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:30:51.555610 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-217b75c6-77c3-4377-bfa1-14d38f55b7a6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:30:51.556439 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-217b75c6-77c3-4377-bfa1-14d38f55b7a6 None None] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:30:51.558985 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-217b75c6-77c3-4377-bfa1-14d38f55b7a6 None None] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:30:51.559428 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_db.sqlalchemy.engines [None req-98ccfb71-9c07-48eb-83d1-8632850eecb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124712) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 15:30:51.561013 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO dbcounter [None req-217b75c6-77c3-4377-bfa1-14d38f55b7a6 None None] Registered counter for database nova_cell0 Jul 20 15:30:51.564898 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writer thread running {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 15:30:51.565067 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO dbcounter [None req-217b75c6-77c3-4377-bfa1-14d38f55b7a6 None None] Registered counter for database nova_cell1 Jul 20 15:30:51.572791 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_db.sqlalchemy.engines [None req-217b75c6-77c3-4377-bfa1-14d38f55b7a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 15:30:51.575719 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_db.sqlalchemy.engines [None req-217b75c6-77c3-4377-bfa1-14d38f55b7a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 15:30:51.582805 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writer thread running {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 15:30:51.584082 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writer thread running {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 15:30:51.733675 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO dbcounter [None req-217b75c6-77c3-4377-bfa1-14d38f55b7a6 None None] Registered counter for database nova_cell0 Jul 20 15:30:51.742524 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_db.sqlalchemy.engines [None req-217b75c6-77c3-4377-bfa1-14d38f55b7a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124711) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 15:30:51.758237 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writer thread running {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 15:30:51.924354 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: WARNING keystonemiddleware.auth_token [None req-98ccfb71-9c07-48eb-83d1-8632850eecb8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 15:30:51.931630 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: WARNING keystonemiddleware.auth_token [None req-98ccfb71-9c07-48eb-83d1-8632850eecb8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 15:30:52.212814 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: WARNING keystonemiddleware.auth_token [None req-217b75c6-77c3-4377-bfa1-14d38f55b7a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 15:30:52.225288 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: WARNING keystonemiddleware.auth_token [None req-217b75c6-77c3-4377-bfa1-14d38f55b7a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 15:30:52.302610 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: WARNING keystonemiddleware.auth_token [None req-98ccfb71-9c07-48eb-83d1-8632850eecb8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 15:30:52.311891 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: WARNING keystonemiddleware.auth_token [None req-98ccfb71-9c07-48eb-83d1-8632850eecb8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 15:30:52.318522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a36fae09c0 pid: 124712 (default app) Jul 20 15:30:52.616221 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: WARNING keystonemiddleware.auth_token [None req-217b75c6-77c3-4377-bfa1-14d38f55b7a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 15:30:52.622943 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: WARNING keystonemiddleware.auth_token [None req-217b75c6-77c3-4377-bfa1-14d38f55b7a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 15:30:52.629181 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a36fae09c0 pid: 124711 (default app) Jul 20 15:31:37.539825 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=3 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:37.550017 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=3 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:37.550017 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=3 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:37.550017 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=3 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:38.636802 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-463deb25-3848-4e83-8dd1-ccd24fa8ad4f tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Action: 'create', calling method: .version_select at 0x7efd92a6dc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1531857530"}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:31:41.169221 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-463deb25-3848-4e83-8dd1-ccd24fa8ad4f tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.642992 Jul 20 15:31:41.178825 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 1/1] 10.222.0.78 () {60 vars in 1154 bytes} [Wed Jul 20 15:31:37 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3647 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 15:31:41.420002 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-409ec60c-91df-408b-8dea-980b38e79928 tempest-VolumesTestJSON-1920675678 tempest-VolumesTestJSON-1920675678-project] Calling method '.version_select at 0x7efd9292da60>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:41.548627 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-409ec60c-91df-408b-8dea-980b38e79928 tempest-VolumesTestJSON-1920675678 tempest-VolumesTestJSON-1920675678-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/bf2447e3-703a-46c9-a47c-70b14e03b243" status: 200 len: 350 microversion: 2.1 time: 0.132372 Jul 20 15:31:41.548627 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 2/2] 10.222.0.78 () {58 vars in 1244 bytes} [Wed Jul 20 15:31:41 2022] GET /compute/v2.1/os-volumes/bf2447e3-703a-46c9-a47c-70b14e03b243 => generated 350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:31:41.755500 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-a19260ea-6d18-4b8c-b17a-799b6e4aac38 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Calling method '.version_select at 0x7efd92b25790>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:41.792978 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=3 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:41.792978 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=3 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:41.793270 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=3 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:41.793996 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=3 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:31:42.698047 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-a19260ea-6d18-4b8c-b17a-799b6e4aac38 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/ed7e148c-f7eb-419c-83a7-8857f3fc7a24" status: 200 len: 346 microversion: 2.1 time: 1.514376 Jul 20 15:31:42.699533 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 1/3] 10.222.0.78 () {58 vars in 1244 bytes} [Wed Jul 20 15:31:41 2022] GET /compute/v2.1/os-volumes/ed7e148c-f7eb-419c-83a7-8857f3fc7a24 => generated 346 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:31:42.716177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-521f05e2-2816-4ce7-8d21-53d469fa7b1f tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Action: 'create', calling method: .version_select at 0x7efd9292dd30>, body: {"snapshot": {"volume_id": "ed7e148c-f7eb-419c-83a7-8857f3fc7a24", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1136433710"}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:31:43.691149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-521f05e2-2816-4ce7-8d21-53d469fa7b1f tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] 10.222.0.78 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.983324 Jul 20 15:31:43.692429 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 3/4] 10.222.0.78 () {60 vars in 1161 bytes} [Wed Jul 20 15:31:42 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:31:43.706434 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-7375ac46-1704-4eee-a621-39676198c9a9 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Calling method '.version_select at 0x7efd92976c10>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:43.839284 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-55b394af-bfbe-4469-89cd-af04bc5440e9 tempest-VolumesTestJSON-1920675678 tempest-VolumesTestJSON-1920675678-project] Calling method '.version_select at 0x7efd9294b790>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:43.867429 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-7375ac46-1704-4eee-a621-39676198c9a9 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/efbbd223-a6a5-4345-b8b7-006aadba3cbd" status: 200 len: 287 microversion: 2.1 time: 0.156822 Jul 20 15:31:43.867429 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 2/5] 10.222.0.78 () {58 vars in 1250 bytes} [Wed Jul 20 15:31:43 2022] GET /compute/v2.1/os-snapshots/efbbd223-a6a5-4345-b8b7-006aadba3cbd => generated 287 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:31:43.885157 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-a49f502b-247e-454c-bef7-d367504dceb5 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Calling method '.version_select at 0x7efd92976d30>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:43.966318 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-55b394af-bfbe-4469-89cd-af04bc5440e9 tempest-VolumesTestJSON-1920675678 tempest-VolumesTestJSON-1920675678-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/4ecde08e-87e8-46ac-91f4-233b68c8ebfb" status: 200 len: 351 microversion: 2.1 time: 0.137938 Jul 20 15:31:43.966943 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 4/6] 10.222.0.78 () {58 vars in 1244 bytes} [Wed Jul 20 15:31:43 2022] GET /compute/v2.1/os-volumes/4ecde08e-87e8-46ac-91f4-233b68c8ebfb => generated 351 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:31:44.023762 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-a49f502b-247e-454c-bef7-d367504dceb5 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.148981 Jul 20 15:31:44.025159 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 3/7] 10.222.0.78 () {58 vars in 1139 bytes} [Wed Jul 20 15:31:43 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:31:44.040939 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-644737b1-4cd5-40f5-8be1-e3ac937dd6c3 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Calling method '.version_select at 0x7efd9294bee0>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:44.574145 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-644737b1-4cd5-40f5-8be1-e3ac937dd6c3 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/efbbd223-a6a5-4345-b8b7-006aadba3cbd" status: 200 len: 287 microversion: 2.1 time: 0.538818 Jul 20 15:31:44.579208 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 5/8] 10.222.0.78 () {58 vars in 1250 bytes} [Wed Jul 20 15:31:44 2022] GET /compute/v2.1/os-snapshots/efbbd223-a6a5-4345-b8b7-006aadba3cbd => generated 287 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:31:45.595176 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-fc2a8575-e6a3-4d51-a351-51bf8e2623ad tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Calling method '.version_select at 0x7efd9293f790>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:45.699228 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-fc2a8575-e6a3-4d51-a351-51bf8e2623ad tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/efbbd223-a6a5-4345-b8b7-006aadba3cbd" status: 200 len: 287 microversion: 2.1 time: 0.101400 Jul 20 15:31:45.699228 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 4/9] 10.222.0.78 () {58 vars in 1250 bytes} [Wed Jul 20 15:31:45 2022] GET /compute/v2.1/os-snapshots/efbbd223-a6a5-4345-b8b7-006aadba3cbd => generated 287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:31:46.705932 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-eecfae1b-432e-48a3-ac77-77f4c52a5a20 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Calling method '.version_select at 0x7efd9294baf0>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:46.777491 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-eecfae1b-432e-48a3-ac77-77f4c52a5a20 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/efbbd223-a6a5-4345-b8b7-006aadba3cbd" status: 200 len: 287 microversion: 2.1 time: 0.076500 Jul 20 15:31:46.778211 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 6/10] 10.222.0.78 () {58 vars in 1250 bytes} [Wed Jul 20 15:31:46 2022] GET /compute/v2.1/os-snapshots/efbbd223-a6a5-4345-b8b7-006aadba3cbd => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:31:47.789754 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-6ebf46b4-ef4b-4de6-8b29-233c4e2d82c1 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Calling method '.version_select at 0x7efd92976af0>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:47.881082 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-6ebf46b4-ef4b-4de6-8b29-233c4e2d82c1 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/efbbd223-a6a5-4345-b8b7-006aadba3cbd" status: 200 len: 288 microversion: 2.1 time: 0.091604 Jul 20 15:31:47.882192 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 5/11] 10.222.0.78 () {58 vars in 1250 bytes} [Wed Jul 20 15:31:47 2022] GET /compute/v2.1/os-snapshots/efbbd223-a6a5-4345-b8b7-006aadba3cbd => generated 288 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:31:47.897876 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-447abf93-bac6-4019-95f9-391502b82dfd tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Calling method '.version_select at 0x7efd9294b3a0>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:48.164228 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-447abf93-bac6-4019-95f9-391502b82dfd tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] 10.222.0.78 "DELETE /compute/v2.1/os-snapshots/efbbd223-a6a5-4345-b8b7-006aadba3cbd" status: 202 len: 0 microversion: 2.1 time: 0.272084 Jul 20 15:31:48.164808 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 7/12] 10.222.0.78 () {58 vars in 1253 bytes} [Wed Jul 20 15:31:47 2022] DELETE /compute/v2.1/os-snapshots/efbbd223-a6a5-4345-b8b7-006aadba3cbd => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 15:31:48.182755 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-06885b2e-b1d5-4886-a924-5d2beb860689 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Calling method '.version_select at 0x7efd9293fd30>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:48.260248 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-06885b2e-b1d5-4886-a924-5d2beb860689 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/efbbd223-a6a5-4345-b8b7-006aadba3cbd" status: 200 len: 287 microversion: 2.1 time: 0.089539 Jul 20 15:31:48.264522 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 6/13] 10.222.0.78 () {58 vars in 1250 bytes} [Wed Jul 20 15:31:48 2022] GET /compute/v2.1/os-snapshots/efbbd223-a6a5-4345-b8b7-006aadba3cbd => generated 287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:31:48.456406 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-6235c3f6-cf65-499f-8f7a-d2a735309f1f tempest-VolumesTestJSON-1920675678 tempest-VolumesTestJSON-1920675678-project] Calling method '.version_select at 0x7efd9292d820>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:48.535835 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-6235c3f6-cf65-499f-8f7a-d2a735309f1f tempest-VolumesTestJSON-1920675678 tempest-VolumesTestJSON-1920675678-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/f426dcb2-d6c9-41bb-a808-173a15bd285e" status: 200 len: 349 microversion: 2.1 time: 0.083185 Jul 20 15:31:48.536408 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 8/14] 10.222.0.78 () {58 vars in 1244 bytes} [Wed Jul 20 15:31:48 2022] GET /compute/v2.1/os-volumes/f426dcb2-d6c9-41bb-a808-173a15bd285e => generated 349 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:31:48.551394 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d699b3dd-ad96-4895-a3cf-77cb27ceb892 tempest-VolumesTestJSON-1920675678 tempest-VolumesTestJSON-1920675678-project] Calling method '.version_select at 0x7efd9293f4c0>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:48.703092 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d699b3dd-ad96-4895-a3cf-77cb27ceb892 tempest-VolumesTestJSON-1920675678 tempest-VolumesTestJSON-1920675678-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.157860 Jul 20 15:31:48.704574 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 7/15] 10.222.0.78 () {58 vars in 1133 bytes} [Wed Jul 20 15:31:48 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:31:48.717085 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-60ea8690-5be7-4446-9d43-cb5ced279356 tempest-VolumesTestJSON-1920675678 tempest-VolumesTestJSON-1920675678-project] Calling method '.version_select at 0x7efd9294b1f0>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:48.817937 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-60ea8690-5be7-4446-9d43-cb5ced279356 tempest-VolumesTestJSON-1920675678 tempest-VolumesTestJSON-1920675678-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.105255 Jul 20 15:31:48.827708 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 9/16] 10.222.0.78 () {58 vars in 1148 bytes} [Wed Jul 20 15:31:48 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:31:48.833649 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-19df9234-ff05-488f-9770-b7ceb721861d tempest-VolumesTestJSON-1920675678 tempest-VolumesTestJSON-1920675678-project] Calling method '.version_select at 0x7efd9293f0d0>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:48.971463 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-19df9234-ff05-488f-9770-b7ceb721861d tempest-VolumesTestJSON-1920675678 tempest-VolumesTestJSON-1920675678-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.142270 Jul 20 15:31:48.972510 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 8/17] 10.222.0.78 () {58 vars in 1133 bytes} [Wed Jul 20 15:31:48 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:31:48.984350 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-347e4471-96c6-45c7-a992-ad686e189834 tempest-VolumesTestJSON-1920675678 tempest-VolumesTestJSON-1920675678-project] Calling method '.version_select at 0x7efd9294be50>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:49.172243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-347e4471-96c6-45c7-a992-ad686e189834 tempest-VolumesTestJSON-1920675678 tempest-VolumesTestJSON-1920675678-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.192071 Jul 20 15:31:49.173117 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 10/18] 10.222.0.78 () {58 vars in 1166 bytes} [Wed Jul 20 15:31:48 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:31:49.187637 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-fdda211f-b6d3-4459-9566-bfe1123ac6c6 tempest-VolumesTestJSON-1920675678 tempest-VolumesTestJSON-1920675678-project] Calling method '.version_select at 0x7efd92976f70>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:49.273313 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-2372e3c2-e75b-4d3c-be14-f7b3971389c6 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Calling method '.version_select at 0x7efd9295d4c0>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:49.321027 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-2372e3c2-e75b-4d3c-be14-f7b3971389c6 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] HTTP exception thrown: Snapshot efbbd223-a6a5-4345-b8b7-006aadba3cbd could not be found. Jul 20 15:31:49.328030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-2372e3c2-e75b-4d3c-be14-f7b3971389c6 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Request method failure captured: Jul 20 15:31:49.328030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: GET /compute/v2.1/os-snapshots/efbbd223-a6a5-4345-b8b7-006aadba3cbd HTTP/1.1 Jul 20 15:31:49.328030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:31:49.328030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:31:49.328030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:31:49.328030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:31:49.328030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:31:49.328030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:31:49.328030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:31:49.328030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:31:49.328030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2B_ZL5BZg_Zf9qJovKVHUamY2Cznkr7RU37s2ffFI_Zn714Yf4-78dRwk3L5mh1tHPD2rybf7bSgnKnDOsFJp3FAw4BTp_Pv1PbsBuGXdPIL3kL3NhSKGxHM_SeH8s9I7DgJs-YtCVtjNphC3c7EVkdebI5CIHwduElV2mq3T3N5Fo0 Jul 20 15:31:49.328030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:31:49.328030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:31:49.328030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:31:49.328030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:31:49.328030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:31:49.328030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:31:49.328030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 99f5f8dca0134df7b339987c309d2382 Jul 20 15:31:49.328030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-305002252 Jul 20 15:31:49.328030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:31:49.328030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:31:49.332509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/99f5f8dca0134df7b339987c309d2382"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/99f5f8dca0134df7b339987c309d2382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_99f5f8dca0134df7b339987c309d2382", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/99f5f8dca0134df7b339987c309d2382"}]}] Jul 20 15:31:49.332509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-VolumesSnapshotsTestJSON-305002252 Jul 20 15:31:49.332509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 99f5f8dca0134df7b339987c309d2382 Jul 20 15:31:49.332509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-305002252 Jul 20 15:31:49.332509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-VolumesSnapshotsTestJSON-305002252-project Jul 20 15:31:49.332509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:31:49.332509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:31:49.332509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: ca0d143cb0154a0d854bdb9509216395 Jul 20 15:31:49.332509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-VolumesSnapshotsTestJSON-305002252-project Jul 20 15:31:49.332509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: Jul 20 15:31:49.332509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Snapshot efbbd223-a6a5-4345-b8b7-006aadba3cbd could not be found. Jul 20 15:31:49.332509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': 'efbbd223-a6a5-4345-b8b7-006aadba3cbd'} Jul 20 15:31:49.332509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:31:49.333163 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:31:49.333163 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 15:31:49.333163 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 15:31:49.333163 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 15:31:49.333163 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 15:31:49.333163 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 15:31:49.333163 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 15:31:49.333163 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 15:31:49.333163 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 15:31:49.333163 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 15:31:49.333163 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 15:31:49.333163 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 15:31:49.333163 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 15:31:49.333163 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 15:31:49.333163 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 15:31:49.333163 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot efbbd223-a6a5-4345-b8b7-006aadba3cbd could not be found. (HTTP 404) (Request-ID: req-db1cdffb-9615-44ef-8ac3-379140f41c47) Jul 20 15:31:49.333163 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:31:49.333163 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:31:49.334160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:31:49.334160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:31:49.334160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 20 15:31:49.334160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 20 15:31:49.334160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 15:31:49.334160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 15:31:49.334160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 20 15:31:49.334160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 20 15:31:49.334160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 15:31:49.334160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 15:31:49.334160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 15:31:49.334160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 15:31:49.334160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 15:31:49.334160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 15:31:49.334160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 15:31:49.334160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 15:31:49.334160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 15:31:49.334160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 15:31:49.334160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 15:31:49.335352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 15:31:49.335352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 15:31:49.335352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 15:31:49.335352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 15:31:49.335352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 15:31:49.335352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot efbbd223-a6a5-4345-b8b7-006aadba3cbd could not be found. Jul 20 15:31:49.335352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:31:49.335352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:31:49.335352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:31:49.335352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:31:49.335352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:31:49.335352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:31:49.335352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:31:49.335352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:31:49.335352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 15:31:49.335352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 15:31:49.335352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:31:49.335352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:31:49.335352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 20 15:31:49.335352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:31:49.336377 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot efbbd223-a6a5-4345-b8b7-006aadba3cbd could not be found. Jul 20 15:31:49.336377 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:31:49.336377 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:31:49.336377 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:31:49.336377 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:31:49.336377 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:31:49.336377 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:31:49.336377 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:31:49.336377 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:31:49.336377 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot efbbd223-a6a5-4345-b8b7-006aadba3cbd could not be found. Jul 20 15:31:49.336377 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:31:49.336377 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-2372e3c2-e75b-4d3c-be14-f7b3971389c6 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Returning 404 to user: Snapshot efbbd223-a6a5-4345-b8b7-006aadba3cbd could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:31:49.336377 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-2372e3c2-e75b-4d3c-be14-f7b3971389c6 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/efbbd223-a6a5-4345-b8b7-006aadba3cbd" status: 404 len: 111 microversion: 2.1 time: 0.061083 Jul 20 15:31:49.336377 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 11/19] 10.222.0.78 () {58 vars in 1250 bytes} [Wed Jul 20 15:31:49 2022] GET /compute/v2.1/os-snapshots/efbbd223-a6a5-4345-b8b7-006aadba3cbd => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 15:31:49.349901 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-3516f376-c4b3-420b-bbb9-fc077a9d0ba5 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Calling method '.version_select at 0x7efd9295d670>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:49.378391 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-fdda211f-b6d3-4459-9566-bfe1123ac6c6 tempest-VolumesTestJSON-1920675678 tempest-VolumesTestJSON-1920675678-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.195131 Jul 20 15:31:49.380000 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 9/20] 10.222.0.78 () {58 vars in 1169 bytes} [Wed Jul 20 15:31:49 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:31:49.394209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-24d40c83-0b91-4c11-b16b-5d717264814f tempest-VolumesTestJSON-1920675678 tempest-VolumesTestJSON-1920675678-project] Calling method '.version_select at 0x7efd9294e550>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:49.539592 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-24d40c83-0b91-4c11-b16b-5d717264814f tempest-VolumesTestJSON-1920675678 tempest-VolumesTestJSON-1920675678-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.149305 Jul 20 15:31:49.548513 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 10/21] 10.222.0.78 () {58 vars in 1154 bytes} [Wed Jul 20 15:31:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:31:49.559027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-adc95b76-6be6-433c-9e38-e7bc9325435d tempest-VolumesTestJSON-1920675678 tempest-VolumesTestJSON-1920675678-project] Calling method '.version_select at 0x7efd92976af0>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:49.663218 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-3516f376-c4b3-420b-bbb9-fc077a9d0ba5 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/ed7e148c-f7eb-419c-83a7-8857f3fc7a24" status: 202 len: 0 microversion: 2.1 time: 0.325705 Jul 20 15:31:49.664796 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 12/22] 10.222.0.78 () {58 vars in 1247 bytes} [Wed Jul 20 15:31:49 2022] DELETE /compute/v2.1/os-volumes/ed7e148c-f7eb-419c-83a7-8857f3fc7a24 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:31:49.674278 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-919e80e2-f0f0-4ccf-8b6c-a7ee4555bcab tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Calling method '.version_select at 0x7efd9295db80>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:49.770701 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-adc95b76-6be6-433c-9e38-e7bc9325435d tempest-VolumesTestJSON-1920675678 tempest-VolumesTestJSON-1920675678-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.216005 Jul 20 15:31:49.771828 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 11/23] 10.222.0.78 () {58 vars in 1187 bytes} [Wed Jul 20 15:31:49 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:31:49.784369 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-cb28d234-c61a-4c67-9ba9-8a9e3625834d tempest-VolumesTestJSON-1920675678 tempest-VolumesTestJSON-1920675678-project] Calling method '.version_select at 0x7efd9293f940>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:49.837590 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-919e80e2-f0f0-4ccf-8b6c-a7ee4555bcab tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/ed7e148c-f7eb-419c-83a7-8857f3fc7a24" status: 200 len: 345 microversion: 2.1 time: 0.168305 Jul 20 15:31:49.838417 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 13/24] 10.222.0.78 () {58 vars in 1244 bytes} [Wed Jul 20 15:31:49 2022] GET /compute/v2.1/os-volumes/ed7e148c-f7eb-419c-83a7-8857f3fc7a24 => generated 345 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:31:50.013995 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-cb28d234-c61a-4c67-9ba9-8a9e3625834d tempest-VolumesTestJSON-1920675678 tempest-VolumesTestJSON-1920675678-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.233847 Jul 20 15:31:50.028358 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 12/25] 10.222.0.78 () {58 vars in 1154 bytes} [Wed Jul 20 15:31:49 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:31:50.851038 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-16df8e92-680e-4397-8b0a-11cb988301c6 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Calling method '.version_select at 0x7efd9292d820>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:50.947919 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-16df8e92-680e-4397-8b0a-11cb988301c6 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/ed7e148c-f7eb-419c-83a7-8857f3fc7a24" status: 200 len: 345 microversion: 2.1 time: 0.100262 Jul 20 15:31:50.948824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 14/26] 10.222.0.78 () {58 vars in 1244 bytes} [Wed Jul 20 15:31:50 2022] GET /compute/v2.1/os-volumes/ed7e148c-f7eb-419c-83a7-8857f3fc7a24 => generated 345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:31:51.762176 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c51315b1-b7fb-441b-b807-bd475fa2cfe2 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Action: 'create', calling method: .version_select at 0x7efd9294ea60>, body: {"keypair": {"name": "tempest-keypair-1033743579", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCp2NpUYcpMpljaK/hI0662q/RgDXUNFB0szQkVwMhWuH+eiF9VcAniciMxDx+bzJh2W/J8VIJvuHfgiCPl4/xJBAAWL5c1Bo2Jfpcy+lXpUP6G4djGsq0yhepHQLunEjA=="}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:31:51.806108 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-3772eb44-edb6-4401-a69b-efe3e772d932 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-172554929", "imageRef": "80914b1c-623c-42a8-810e-836b2cce0d3b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:31:51.957757 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-c51315b1-b7fb-441b-b807-bd475fa2cfe2 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Getting quotas for project aa49d7002cf441348cf3166e64b1bc87. Resources: {'key_pairs'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:31:51.990936 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-c51315b1-b7fb-441b-b807-bd475fa2cfe2 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Getting quotas for user 8e75c180bae74be0b2ccad079f92d32b and project aa49d7002cf441348cf3166e64b1bc87. Resources: {'key_pairs'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:31:52.160420 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.network.neutron [None req-3772eb44-edb6-4401-a69b-efe3e772d932 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] validate_networks() for [('49eaadcd-4166-45bc-8081-db7a31ee5c71', None, None, None, None, None)] {{(pid=124712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 15:31:52.176748 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c51315b1-b7fb-441b-b807-bd475fa2cfe2 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.733291 Jul 20 15:31:52.183058 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 13/27] 10.222.0.78 () {60 vars in 1158 bytes} [Wed Jul 20 15:31:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:31:52.184412 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-17ef689e-3d6f-421f-896c-cb8f625ba873 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Calling method '.version_select at 0x7efd928cf160>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:52.299669 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-17ef689e-3d6f-421f-896c-cb8f625ba873 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/ed7e148c-f7eb-419c-83a7-8857f3fc7a24" status: 200 len: 345 microversion: 2.1 time: 0.119752 Jul 20 15:31:52.300990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 14/28] 10.222.0.78 () {58 vars in 1244 bytes} [Wed Jul 20 15:31:52 2022] GET /compute/v2.1/os-volumes/ed7e148c-f7eb-419c-83a7-8857f3fc7a24 => generated 345 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:31:53.313481 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d3dab8c7-e868-4c93-8c57-16691d2f98a6 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Calling method '.version_select at 0x7efd928cf820>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:53.575414 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-d3dab8c7-e868-4c93-8c57-16691d2f98a6 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] HTTP exception thrown: Volume ed7e148c-f7eb-419c-83a7-8857f3fc7a24 could not be found. Jul 20 15:31:53.579717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d3dab8c7-e868-4c93-8c57-16691d2f98a6 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Request method failure captured: Jul 20 15:31:53.579717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: GET /compute/v2.1/os-volumes/ed7e148c-f7eb-419c-83a7-8857f3fc7a24 HTTP/1.1 Jul 20 15:31:53.579717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:31:53.579717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:31:53.579717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:31:53.579717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:31:53.579717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:31:53.579717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:31:53.579717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:31:53.579717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:31:53.579717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2B_ZL5BZg_Zf9qJovKVHUamY2Cznkr7RU37s2ffFI_Zn714Yf4-78dRwk3L5mh1tHPD2rybf7bSgnKnDOsFJp3FAw4BTp_Pv1PbsBuGXdPIL3kL3NhSKGxHM_SeH8s9I7DgJs-YtCVtjNphC3c7EVkdebI5CIHwduElV2mq3T3N5Fo0 Jul 20 15:31:53.579717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:31:53.579717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:31:53.579717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:31:53.579717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:31:53.579717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:31:53.579717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:31:53.579717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: 99f5f8dca0134df7b339987c309d2382 Jul 20 15:31:53.579717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-305002252 Jul 20 15:31:53.579717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:31:53.579717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:31:53.584610 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/99f5f8dca0134df7b339987c309d2382"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/99f5f8dca0134df7b339987c309d2382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_99f5f8dca0134df7b339987c309d2382", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/99f5f8dca0134df7b339987c309d2382"}]}] Jul 20 15:31:53.584610 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-VolumesSnapshotsTestJSON-305002252 Jul 20 15:31:53.584610 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: 99f5f8dca0134df7b339987c309d2382 Jul 20 15:31:53.584610 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-305002252 Jul 20 15:31:53.584610 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-VolumesSnapshotsTestJSON-305002252-project Jul 20 15:31:53.584610 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:31:53.584610 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:31:53.584610 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: ca0d143cb0154a0d854bdb9509216395 Jul 20 15:31:53.584610 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-VolumesSnapshotsTestJSON-305002252-project Jul 20 15:31:53.584610 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: Jul 20 15:31:53.584610 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Volume ed7e148c-f7eb-419c-83a7-8857f3fc7a24 could not be found. Jul 20 15:31:53.584610 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': 'ed7e148c-f7eb-419c-83a7-8857f3fc7a24'} Jul 20 15:31:53.584610 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:31:53.585479 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:31:53.585479 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 15:31:53.585479 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 15:31:53.585479 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 15:31:53.585479 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 15:31:53.585479 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 15:31:53.585479 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 15:31:53.585479 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 15:31:53.585479 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 15:31:53.585479 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 15:31:53.585479 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 15:31:53.585479 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 15:31:53.585479 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 15:31:53.585479 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 15:31:53.585479 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 15:31:53.585479 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed7e148c-f7eb-419c-83a7-8857f3fc7a24 could not be found. (HTTP 404) (Request-ID: req-40a55b6b-b570-421e-971d-efe79c43307a) Jul 20 15:31:53.585479 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:31:53.585479 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:31:53.585479 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:31:53.586509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:31:53.586509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 15:31:53.586509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 15:31:53.586509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 15:31:53.586509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 15:31:53.586509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 15:31:53.586509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 15:31:53.586509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 15:31:53.586509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 15:31:53.586509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 15:31:53.586509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 15:31:53.586509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 15:31:53.586509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 15:31:53.586509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 15:31:53.586509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 15:31:53.586509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 15:31:53.586509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 15:31:53.586509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 15:31:53.586509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 15:31:53.587668 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 15:31:53.587668 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 15:31:53.587668 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 15:31:53.587668 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 15:31:53.587668 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed7e148c-f7eb-419c-83a7-8857f3fc7a24 could not be found. Jul 20 15:31:53.587668 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:31:53.587668 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:31:53.587668 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:31:53.587668 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:31:53.587668 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:31:53.587668 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:31:53.587668 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:31:53.587668 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:31:53.587668 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 15:31:53.587668 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 15:31:53.587668 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:31:53.587668 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:31:53.587668 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 15:31:53.587668 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:31:53.589326 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed7e148c-f7eb-419c-83a7-8857f3fc7a24 could not be found. Jul 20 15:31:53.589326 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:31:53.589326 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:31:53.589326 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:31:53.589326 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:31:53.589326 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:31:53.589326 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:31:53.589326 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:31:53.589326 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:31:53.589326 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed7e148c-f7eb-419c-83a7-8857f3fc7a24 could not be found. Jul 20 15:31:53.589326 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:31:53.589326 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d3dab8c7-e868-4c93-8c57-16691d2f98a6 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Returning 404 to user: Volume ed7e148c-f7eb-419c-83a7-8857f3fc7a24 could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:31:53.589326 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d3dab8c7-e868-4c93-8c57-16691d2f98a6 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/ed7e148c-f7eb-419c-83a7-8857f3fc7a24" status: 404 len: 109 microversion: 2.1 time: 0.272148 Jul 20 15:31:53.589326 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 15/29] 10.222.0.78 () {58 vars in 1244 bytes} [Wed Jul 20 15:31:53 2022] GET /compute/v2.1/os-volumes/ed7e148c-f7eb-419c-83a7-8857f3fc7a24 => generated 109 bytes in 273 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 15:31:53.608352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-dae90338-abe3-4b54-a995-76ebbd9379a4 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Calling method '.version_select at 0x7efd9203b5e0>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:53.718682 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-dae90338-abe3-4b54-a995-76ebbd9379a4 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] HTTP exception thrown: Volume ed7e148c-f7eb-419c-83a7-8857f3fc7a24 could not be found. Jul 20 15:31:53.721535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-dae90338-abe3-4b54-a995-76ebbd9379a4 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Request method failure captured: Jul 20 15:31:53.721535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: DELETE /compute/v2.1/os-volumes/ed7e148c-f7eb-419c-83a7-8857f3fc7a24 HTTP/1.1 Jul 20 15:31:53.721535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:31:53.721535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:31:53.721535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:31:53.721535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:31:53.721535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:31:53.721535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:31:53.721535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:31:53.721535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:31:53.721535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2B_ZL5BZg_Zf9qJovKVHUamY2Cznkr7RU37s2ffFI_Zn714Yf4-78dRwk3L5mh1tHPD2rybf7bSgnKnDOsFJp3FAw4BTp_Pv1PbsBuGXdPIL3kL3NhSKGxHM_SeH8s9I7DgJs-YtCVtjNphC3c7EVkdebI5CIHwduElV2mq3T3N5Fo0 Jul 20 15:31:53.721535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:31:53.721535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:31:53.721535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:31:53.721535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:31:53.721535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:31:53.721535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:31:53.721535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: 99f5f8dca0134df7b339987c309d2382 Jul 20 15:31:53.721535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-305002252 Jul 20 15:31:53.721535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:31:53.721535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:31:53.723111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/99f5f8dca0134df7b339987c309d2382"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/99f5f8dca0134df7b339987c309d2382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_99f5f8dca0134df7b339987c309d2382", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/99f5f8dca0134df7b339987c309d2382"}]}] Jul 20 15:31:53.723111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-VolumesSnapshotsTestJSON-305002252 Jul 20 15:31:53.723111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: 99f5f8dca0134df7b339987c309d2382 Jul 20 15:31:53.723111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-305002252 Jul 20 15:31:53.723111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-VolumesSnapshotsTestJSON-305002252-project Jul 20 15:31:53.723111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:31:53.723111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:31:53.723111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: ca0d143cb0154a0d854bdb9509216395 Jul 20 15:31:53.723111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-VolumesSnapshotsTestJSON-305002252-project Jul 20 15:31:53.723111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: Jul 20 15:31:53.723111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Volume ed7e148c-f7eb-419c-83a7-8857f3fc7a24 could not be found. Jul 20 15:31:53.723111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': 'ed7e148c-f7eb-419c-83a7-8857f3fc7a24'} Jul 20 15:31:53.723111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:31:53.724196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:31:53.724196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 15:31:53.724196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 15:31:53.724196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 15:31:53.724196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 15:31:53.724196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 15:31:53.724196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 15:31:53.724196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 15:31:53.724196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 15:31:53.724196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 15:31:53.724196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 15:31:53.724196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 15:31:53.724196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 15:31:53.724196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 15:31:53.724196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 15:31:53.724196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed7e148c-f7eb-419c-83a7-8857f3fc7a24 could not be found. (HTTP 404) (Request-ID: req-e6a109bb-958f-4cb0-b68a-559c77ff2f83) Jul 20 15:31:53.724196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:31:53.724196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:31:53.724196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:31:53.725416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:31:53.725416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 15:31:53.725416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 15:31:53.725416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 15:31:53.725416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 15:31:53.725416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 15:31:53.725416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 15:31:53.725416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 15:31:53.725416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 15:31:53.725416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 15:31:53.725416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 15:31:53.725416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 15:31:53.725416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 15:31:53.725416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 15:31:53.725416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 15:31:53.725416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 15:31:53.725416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 15:31:53.725416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 15:31:53.725416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 15:31:53.726556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 15:31:53.726556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 15:31:53.726556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 15:31:53.726556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 15:31:53.726556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed7e148c-f7eb-419c-83a7-8857f3fc7a24 could not be found. Jul 20 15:31:53.726556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:31:53.726556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:31:53.726556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:31:53.726556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:31:53.726556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:31:53.726556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:31:53.726556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:31:53.726556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:31:53.726556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 15:31:53.726556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 15:31:53.726556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:31:53.726556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:31:53.726556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 15:31:53.726556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:31:53.727820 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed7e148c-f7eb-419c-83a7-8857f3fc7a24 could not be found. Jul 20 15:31:53.727820 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:31:53.727820 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:31:53.727820 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:31:53.727820 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:31:53.727820 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:31:53.727820 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:31:53.727820 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:31:53.727820 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:31:53.727820 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed7e148c-f7eb-419c-83a7-8857f3fc7a24 could not be found. Jul 20 15:31:53.727820 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:31:53.727820 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-dae90338-abe3-4b54-a995-76ebbd9379a4 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Returning 404 to user: Volume ed7e148c-f7eb-419c-83a7-8857f3fc7a24 could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:31:53.727820 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-dae90338-abe3-4b54-a995-76ebbd9379a4 tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/ed7e148c-f7eb-419c-83a7-8857f3fc7a24" status: 404 len: 109 microversion: 2.1 time: 0.119695 Jul 20 15:31:53.727820 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 16/30] 10.222.0.78 () {58 vars in 1247 bytes} [Wed Jul 20 15:31:53 2022] DELETE /compute/v2.1/os-volumes/ed7e148c-f7eb-419c-83a7-8857f3fc7a24 => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:31:53.735024 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-65d2d754-07ca-4ed5-90da-b59967d5269a tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Calling method '.version_select at 0x7efd9203b790>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:54.060294 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-65d2d754-07ca-4ed5-90da-b59967d5269a tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] HTTP exception thrown: Volume ed7e148c-f7eb-419c-83a7-8857f3fc7a24 could not be found. Jul 20 15:31:54.062872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-65d2d754-07ca-4ed5-90da-b59967d5269a tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Request method failure captured: Jul 20 15:31:54.062872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: GET /compute/v2.1/os-volumes/ed7e148c-f7eb-419c-83a7-8857f3fc7a24 HTTP/1.1 Jul 20 15:31:54.062872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:31:54.062872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:31:54.062872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:31:54.062872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:31:54.062872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:31:54.062872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:31:54.062872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:31:54.062872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:31:54.062872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2B_ZL5BZg_Zf9qJovKVHUamY2Cznkr7RU37s2ffFI_Zn714Yf4-78dRwk3L5mh1tHPD2rybf7bSgnKnDOsFJp3FAw4BTp_Pv1PbsBuGXdPIL3kL3NhSKGxHM_SeH8s9I7DgJs-YtCVtjNphC3c7EVkdebI5CIHwduElV2mq3T3N5Fo0 Jul 20 15:31:54.062872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:31:54.062872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:31:54.062872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:31:54.062872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:31:54.062872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:31:54.062872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:31:54.062872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: 99f5f8dca0134df7b339987c309d2382 Jul 20 15:31:54.062872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-305002252 Jul 20 15:31:54.062872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:31:54.062872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:31:54.064361 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/99f5f8dca0134df7b339987c309d2382"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/99f5f8dca0134df7b339987c309d2382"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_99f5f8dca0134df7b339987c309d2382", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/99f5f8dca0134df7b339987c309d2382"}]}] Jul 20 15:31:54.064361 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-VolumesSnapshotsTestJSON-305002252 Jul 20 15:31:54.064361 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: 99f5f8dca0134df7b339987c309d2382 Jul 20 15:31:54.064361 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-305002252 Jul 20 15:31:54.064361 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-VolumesSnapshotsTestJSON-305002252-project Jul 20 15:31:54.064361 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:31:54.064361 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:31:54.064361 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: ca0d143cb0154a0d854bdb9509216395 Jul 20 15:31:54.064361 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-VolumesSnapshotsTestJSON-305002252-project Jul 20 15:31:54.064361 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: Jul 20 15:31:54.064361 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Volume ed7e148c-f7eb-419c-83a7-8857f3fc7a24 could not be found. Jul 20 15:31:54.064361 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': 'ed7e148c-f7eb-419c-83a7-8857f3fc7a24'} Jul 20 15:31:54.064361 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:31:54.065042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:31:54.065042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 15:31:54.065042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 15:31:54.065042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 15:31:54.065042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 15:31:54.065042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 15:31:54.065042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 15:31:54.065042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 15:31:54.065042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 15:31:54.065042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 15:31:54.065042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 15:31:54.065042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 15:31:54.065042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 15:31:54.065042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 15:31:54.065042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 15:31:54.065042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed7e148c-f7eb-419c-83a7-8857f3fc7a24 could not be found. (HTTP 404) (Request-ID: req-297debfe-b58d-49d4-bd12-6796bb7322d9) Jul 20 15:31:54.065042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:31:54.065042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:31:54.065042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:31:54.065991 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:31:54.065991 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 15:31:54.065991 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 15:31:54.065991 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 15:31:54.065991 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 15:31:54.065991 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 15:31:54.065991 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 15:31:54.065991 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 15:31:54.065991 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 15:31:54.065991 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 15:31:54.065991 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 15:31:54.065991 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 15:31:54.065991 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 15:31:54.065991 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 15:31:54.065991 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 15:31:54.065991 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 15:31:54.065991 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 15:31:54.065991 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 15:31:54.065991 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 15:31:54.067352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 15:31:54.067352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 15:31:54.067352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 15:31:54.067352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 15:31:54.067352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed7e148c-f7eb-419c-83a7-8857f3fc7a24 could not be found. Jul 20 15:31:54.067352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:31:54.067352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:31:54.067352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:31:54.067352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:31:54.067352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:31:54.067352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:31:54.067352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:31:54.067352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:31:54.067352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 15:31:54.067352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 15:31:54.067352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:31:54.067352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:31:54.067352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 15:31:54.067352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:31:54.068278 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed7e148c-f7eb-419c-83a7-8857f3fc7a24 could not be found. Jul 20 15:31:54.068278 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:31:54.068278 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:31:54.068278 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:31:54.068278 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:31:54.068278 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:31:54.068278 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:31:54.068278 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:31:54.068278 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:31:54.068278 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed7e148c-f7eb-419c-83a7-8857f3fc7a24 could not be found. Jul 20 15:31:54.068278 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:31:54.068278 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-65d2d754-07ca-4ed5-90da-b59967d5269a tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] Returning 404 to user: Volume ed7e148c-f7eb-419c-83a7-8857f3fc7a24 could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:31:54.068278 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-65d2d754-07ca-4ed5-90da-b59967d5269a tempest-VolumesSnapshotsTestJSON-305002252 tempest-VolumesSnapshotsTestJSON-305002252-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/ed7e148c-f7eb-419c-83a7-8857f3fc7a24" status: 404 len: 109 microversion: 2.1 time: 0.334108 Jul 20 15:31:54.068278 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 17/31] 10.222.0.78 () {58 vars in 1244 bytes} [Wed Jul 20 15:31:53 2022] GET /compute/v2.1/os-volumes/ed7e148c-f7eb-419c-83a7-8857f3fc7a24 => generated 109 bytes in 335 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:31:54.455254 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-3772eb44-edb6-4401-a69b-efe3e772d932 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Flavor limits 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 15:31:54.455976 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-3772eb44-edb6-4401-a69b-efe3e772d932 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Image limits 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 15:31:54.456841 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-3772eb44-edb6-4401-a69b-efe3e772d932 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Flavor pref 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 15:31:54.457528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-3772eb44-edb6-4401-a69b-efe3e772d932 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Image pref 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 15:31:54.458291 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-3772eb44-edb6-4401-a69b-efe3e772d932 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 15:31:54.531657 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3772eb44-edb6-4401-a69b-efe3e772d932 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:31:54.532103 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3772eb44-edb6-4401-a69b-efe3e772d932 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:31:54.532891 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3772eb44-edb6-4401-a69b-efe3e772d932 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:31:54.533508 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3772eb44-edb6-4401-a69b-efe3e772d932 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:31:54.613124 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-3772eb44-edb6-4401-a69b-efe3e772d932 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Getting quotas for project 61872ef687074f5791a2cc46732bebdf. Resources: {'instances', 'ram', 'cores'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:31:54.625504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-3772eb44-edb6-4401-a69b-efe3e772d932 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Getting quotas for user ebbcfe6341a3486d93e12c09f83954dc and project 61872ef687074f5791a2cc46732bebdf. Resources: {'instances', 'ram', 'cores'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:31:54.654217 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-3772eb44-edb6-4401-a69b-efe3e772d932 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Going to run 1 instances... {{(pid=124712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 15:31:54.659571 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-3772eb44-edb6-4401-a69b-efe3e772d932 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80914b1c-623c-42a8-810e-836b2cce0d3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 15:31:54.978017 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-3772eb44-edb6-4401-a69b-efe3e772d932 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.309274 Jul 20 15:31:54.988735 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 15/32] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Jul 20 15:31:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 3313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 15:31:55.004376 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-516db721-1604-46cb-a686-3a2920648f04 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:55.005690 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-516db721-1604-46cb-a686-3a2920648f04 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:31:55.714470 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-516db721-1604-46cb-a686-3a2920648f04 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:31:55.765182 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-516db721-1604-46cb-a686-3a2920648f04 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1221 microversion: 2.1 time: 0.776122 Jul 20 15:31:55.777815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 18/33] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:31:54 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1221 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:31:56.287539 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-52bc61a5-17ba-4ac9-9af4-40f337d3c91d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-396509419", "imageRef": "80914b1c-623c-42a8-810e-836b2cce0d3b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:31:56.454992 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.network.neutron [None req-52bc61a5-17ba-4ac9-9af4-40f337d3c91d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] validate_networks() for [('49eaadcd-4166-45bc-8081-db7a31ee5c71', None, None, None, None, None)] {{(pid=124712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 15:31:57.669014 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-52bc61a5-17ba-4ac9-9af4-40f337d3c91d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Flavor limits 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 15:31:57.669014 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-52bc61a5-17ba-4ac9-9af4-40f337d3c91d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Image limits 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 15:31:57.669014 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-52bc61a5-17ba-4ac9-9af4-40f337d3c91d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Flavor pref 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 15:31:57.669014 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-52bc61a5-17ba-4ac9-9af4-40f337d3c91d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Image pref 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 15:31:57.669930 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-52bc61a5-17ba-4ac9-9af4-40f337d3c91d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 15:31:57.681199 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-52bc61a5-17ba-4ac9-9af4-40f337d3c91d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:31:57.681777 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-52bc61a5-17ba-4ac9-9af4-40f337d3c91d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:31:57.682884 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-52bc61a5-17ba-4ac9-9af4-40f337d3c91d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:31:57.683446 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-52bc61a5-17ba-4ac9-9af4-40f337d3c91d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:31:57.705080 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-52bc61a5-17ba-4ac9-9af4-40f337d3c91d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Getting quotas for project 61872ef687074f5791a2cc46732bebdf. Resources: {'instances', 'ram', 'cores'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:31:57.711737 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-52bc61a5-17ba-4ac9-9af4-40f337d3c91d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Getting quotas for user ebbcfe6341a3486d93e12c09f83954dc and project 61872ef687074f5791a2cc46732bebdf. Resources: {'instances', 'ram', 'cores'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:31:57.732281 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-52bc61a5-17ba-4ac9-9af4-40f337d3c91d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Going to run 1 instances... {{(pid=124712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 15:31:57.735536 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-52bc61a5-17ba-4ac9-9af4-40f337d3c91d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80914b1c-623c-42a8-810e-836b2cce0d3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 15:31:57.850442 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-a0fc80a9-2754-4c6c-ae30-aa04b2b0bd45 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Action: 'create', calling method: .version_select at 0x7efd9203bee0>, body: {"keypair": {"name": "tempest-keypair-1394049907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUTiGZxVh8zI82CkbbjmAmCI+i+tLYdH4fZapdi1gSeLMlCOzN/3GiV8NcbYRd6JmHsftfOze8a0cmzZQeU0wkQtygSH6f8q7VAwaN52j5uIpincqoBZ2iJPxVzg+d4rg=="}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:31:57.898453 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-a0fc80a9-2754-4c6c-ae30-aa04b2b0bd45 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Getting quotas for project 4446d4a6f4e64ccb8bfd5b3fe6f2127a. Resources: {'key_pairs'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:31:57.923905 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-52bc61a5-17ba-4ac9-9af4-40f337d3c91d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.643972 Jul 20 15:31:57.932911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-a0fc80a9-2754-4c6c-ae30-aa04b2b0bd45 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Getting quotas for user 6498ef5c517c4fa4abed90e430936ded and project 4446d4a6f4e64ccb8bfd5b3fe6f2127a. Resources: {'key_pairs'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:31:57.933941 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 16/34] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Jul 20 15:31:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 1655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 15:31:57.953550 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-60c10e96-ce17-48ca-bd77-306101e3b43a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:57.957067 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-60c10e96-ce17-48ca-bd77-306101e3b43a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:31:58.175168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-a0fc80a9-2754-4c6c-ae30-aa04b2b0bd45 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.585536 Jul 20 15:31:58.175168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 19/35] 10.222.0.78 () {62 vars in 1199 bytes} [Wed Jul 20 15:31:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 587 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 20 15:31:58.260851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-60c10e96-ce17-48ca-bd77-306101e3b43a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:31:58.316011 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-60c10e96-ce17-48ca-bd77-306101e3b43a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1221 microversion: 2.1 time: 0.374857 Jul 20 15:31:58.319721 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 17/36] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:31:57 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1221 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:31:59.338162 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-9ecd96ab-cd3f-4b48-a909-b1e7199692fe tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:31:59.339034 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-9ecd96ab-cd3f-4b48-a909-b1e7199692fe tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:31:59.640109 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ec030d44-4b48-43ea-9706-d3373607f570 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1601121786", "imageRef": "80914b1c-623c-42a8-810e-836b2cce0d3b", "flavorRef": "452", "networks": [{"uuid": "87b7a7e3-0142-4612-bb7a-59e6264b0abe"}]}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:31:59.703883 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-9ecd96ab-cd3f-4b48-a909-b1e7199692fe tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:31:59.727117 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-9ecd96ab-cd3f-4b48-a909-b1e7199692fe tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1221 microversion: 2.1 time: 0.389990 Jul 20 15:31:59.730131 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 18/37] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:31:59 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1221 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:31:59.899446 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.network.neutron [None req-ec030d44-4b48-43ea-9706-d3373607f570 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] validate_networks() for [('87b7a7e3-0142-4612-bb7a-59e6264b0abe', None, None, None, None, None)] {{(pid=124711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 15:32:00.756717 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-673fcca7-ad7a-4f33-980a-2b2a289e2769 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:00.758577 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-673fcca7-ad7a-4f33-980a-2b2a289e2769 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:00.778732 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-673fcca7-ad7a-4f33-980a-2b2a289e2769 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:00.780315 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-673fcca7-ad7a-4f33-980a-2b2a289e2769 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:00.782310 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-673fcca7-ad7a-4f33-980a-2b2a289e2769 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:00.783166 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-673fcca7-ad7a-4f33-980a-2b2a289e2769 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:01.132117 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-673fcca7-ad7a-4f33-980a-2b2a289e2769 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:01.175326 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-673fcca7-ad7a-4f33-980a-2b2a289e2769 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1225 microversion: 2.1 time: 0.429244 Jul 20 15:32:01.193203 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 19/38] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:00 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1225 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:32:01.209932 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-abab6b57-1760-4881-b1d9-474a2999348c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-245840812", "imageRef": "80914b1c-623c-42a8-810e-836b2cce0d3b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa5e056d-5a56-4462-a470-30c02f844e62"}], "security_groups": [{"name": "tempest-securitygroup--2036846493"}], "key_name": "tempest-keypair-1033743579", "user_data": "}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:32:02.699986 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-ec030d44-4b48-43ea-9706-d3373607f570 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Flavor limits 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 15:32:02.701187 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-ec030d44-4b48-43ea-9706-d3373607f570 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Image limits 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 15:32:02.702010 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-ec030d44-4b48-43ea-9706-d3373607f570 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Flavor pref 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 15:32:02.702616 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-ec030d44-4b48-43ea-9706-d3373607f570 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Image pref 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 15:32:02.703537 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-ec030d44-4b48-43ea-9706-d3373607f570 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 15:32:02.724811 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ec030d44-4b48-43ea-9706-d3373607f570 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:02.730612 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ec030d44-4b48-43ea-9706-d3373607f570 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:02.735234 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ec030d44-4b48-43ea-9706-d3373607f570 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:02.736149 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ec030d44-4b48-43ea-9706-d3373607f570 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:02.896273 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-ec030d44-4b48-43ea-9706-d3373607f570 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Getting quotas for project 80caade751834762862c102c208a34e1. Resources: {'instances', 'ram', 'cores'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:32:02.914882 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-ec030d44-4b48-43ea-9706-d3373607f570 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Getting quotas for user 48ce3bfba3724b07a657774662b8d6f3 and project 80caade751834762862c102c208a34e1. Resources: {'instances', 'ram', 'cores'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:32:02.954075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ec030d44-4b48-43ea-9706-d3373607f570 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Going to run 1 instances... {{(pid=124711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 15:32:02.957531 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ec030d44-4b48-43ea-9706-d3373607f570 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80914b1c-623c-42a8-810e-836b2cce0d3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 15:32:03.247971 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.network.neutron [None req-abab6b57-1760-4881-b1d9-474a2999348c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] validate_networks() for [('fa5e056d-5a56-4462-a470-30c02f844e62', None, None, None, None, None)] {{(pid=124712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 15:32:03.326476 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-ec030d44-4b48-43ea-9706-d3373607f570 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.395964 Jul 20 15:32:03.332840 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 20/39] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Jul 20 15:31:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 4403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 15:32:03.351525 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-32b2d275-b5f2-4310-bc11-ed5b76f4d553 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:03.354023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-32b2d275-b5f2-4310-bc11-ed5b76f4d553 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:03.366586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-32b2d275-b5f2-4310-bc11-ed5b76f4d553 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:03.367036 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-32b2d275-b5f2-4310-bc11-ed5b76f4d553 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:03.368069 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-32b2d275-b5f2-4310-bc11-ed5b76f4d553 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:03.369234 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-32b2d275-b5f2-4310-bc11-ed5b76f4d553 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:03.857509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-32b2d275-b5f2-4310-bc11-ed5b76f4d553 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:03.907621 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-32b2d275-b5f2-4310-bc11-ed5b76f4d553 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1279 microversion: 2.1 time: 0.572918 Jul 20 15:32:03.908919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 21/40] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:03 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1279 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:03.925640 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c95072b7-d8fe-40bb-8c9e-b9f54c1d1961 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:03.926877 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c95072b7-d8fe-40bb-8c9e-b9f54c1d1961 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:04.757380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c95072b7-d8fe-40bb-8c9e-b9f54c1d1961 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:04.768238 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c95072b7-d8fe-40bb-8c9e-b9f54c1d1961 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1215 microversion: 2.1 time: 0.857706 Jul 20 15:32:04.779187 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 22/41] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:03 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1215 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:04.940801 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-a0b3a025-8dfb-4896-b326-7dc4797fad32 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:04.945612 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-a0b3a025-8dfb-4896-b326-7dc4797fad32 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:04.973214 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a0b3a025-8dfb-4896-b326-7dc4797fad32 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:04.974368 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a0b3a025-8dfb-4896-b326-7dc4797fad32 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:04.979885 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a0b3a025-8dfb-4896-b326-7dc4797fad32 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:04.980568 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a0b3a025-8dfb-4896-b326-7dc4797fad32 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:05.334095 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-a0b3a025-8dfb-4896-b326-7dc4797fad32 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:05.362140 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-a0b3a025-8dfb-4896-b326-7dc4797fad32 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1279 microversion: 2.1 time: 0.429448 Jul 20 15:32:05.379826 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 23/42] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:04 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1279 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:32:05.798333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-20cd5ca1-0bd3-4273-8e81-ab13210bc6a1 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:05.799331 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-20cd5ca1-0bd3-4273-8e81-ab13210bc6a1 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:05.820289 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-20cd5ca1-0bd3-4273-8e81-ab13210bc6a1 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:05.827323 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-20cd5ca1-0bd3-4273-8e81-ab13210bc6a1 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:05.833578 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-20cd5ca1-0bd3-4273-8e81-ab13210bc6a1 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:05.857600 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-20cd5ca1-0bd3-4273-8e81-ab13210bc6a1 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:07.454229 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-20cd5ca1-0bd3-4273-8e81-ab13210bc6a1 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:07.474661 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-20cd5ca1-0bd3-4273-8e81-ab13210bc6a1 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1219 microversion: 2.1 time: 1.680821 Jul 20 15:32:07.496717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 24/43] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:05 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1219 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:32:07.514555 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5d9c3dc9-bada-49ab-8b4b-8ec78787900f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:07.517436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5d9c3dc9-bada-49ab-8b4b-8ec78787900f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:07.534486 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5d9c3dc9-bada-49ab-8b4b-8ec78787900f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:07.544899 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5d9c3dc9-bada-49ab-8b4b-8ec78787900f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:07.545990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5d9c3dc9-bada-49ab-8b4b-8ec78787900f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:07.547776 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5d9c3dc9-bada-49ab-8b4b-8ec78787900f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:07.692712 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=4 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:09.709126 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=16 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:10.066221 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5d9c3dc9-bada-49ab-8b4b-8ec78787900f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:10.079646 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-abab6b57-1760-4881-b1d9-474a2999348c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Flavor limits 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 15:32:10.080075 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-abab6b57-1760-4881-b1d9-474a2999348c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Image limits 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 15:32:10.089633 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-abab6b57-1760-4881-b1d9-474a2999348c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Flavor pref 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 15:32:10.091015 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-abab6b57-1760-4881-b1d9-474a2999348c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Image pref 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 15:32:10.091939 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-abab6b57-1760-4881-b1d9-474a2999348c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 15:32:10.156888 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5d9c3dc9-bada-49ab-8b4b-8ec78787900f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1321 microversion: 2.1 time: 2.647556 Jul 20 15:32:10.162677 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 25/44] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:07 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1321 bytes in 2665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:10.165994 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-abab6b57-1760-4881-b1d9-474a2999348c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:10.166814 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-abab6b57-1760-4881-b1d9-474a2999348c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:10.173698 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-abab6b57-1760-4881-b1d9-474a2999348c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:10.175565 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-abab6b57-1760-4881-b1d9-474a2999348c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:10.185413 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e4108509-dcc6-4f3c-a7e0-64e2042be67e tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:10.190570 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e4108509-dcc6-4f3c-a7e0-64e2042be67e tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:10.223105 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e4108509-dcc6-4f3c-a7e0-64e2042be67e tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:10.234466 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e4108509-dcc6-4f3c-a7e0-64e2042be67e tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:10.246056 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e4108509-dcc6-4f3c-a7e0-64e2042be67e tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:10.246056 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e4108509-dcc6-4f3c-a7e0-64e2042be67e tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:10.300852 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-abab6b57-1760-4881-b1d9-474a2999348c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Getting quotas for project aa49d7002cf441348cf3166e64b1bc87. Resources: {'instances', 'ram', 'cores'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:32:10.337373 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-abab6b57-1760-4881-b1d9-474a2999348c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Getting quotas for user 8e75c180bae74be0b2ccad079f92d32b and project aa49d7002cf441348cf3166e64b1bc87. Resources: {'instances', 'ram', 'cores'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:32:10.403377 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-abab6b57-1760-4881-b1d9-474a2999348c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Going to run 1 instances... {{(pid=124712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 15:32:10.403377 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-abab6b57-1760-4881-b1d9-474a2999348c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80914b1c-623c-42a8-810e-836b2cce0d3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 15:32:10.762850 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-abab6b57-1760-4881-b1d9-474a2999348c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 9.567774 Jul 20 15:32:10.763544 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 20/45] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Jul 20 15:32:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 9569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 15:32:10.811964 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-f2df0c99-22e3-4a85-b4bd-6bdbd2ec59aa tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:10.819316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-f2df0c99-22e3-4a85-b4bd-6bdbd2ec59aa tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:11.363693 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e4108509-dcc6-4f3c-a7e0-64e2042be67e tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:11.373442 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-f2df0c99-22e3-4a85-b4bd-6bdbd2ec59aa tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:11.383332 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-f2df0c99-22e3-4a85-b4bd-6bdbd2ec59aa tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1237 microversion: 2.1 time: 0.612221 Jul 20 15:32:11.385126 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 21/46] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:10 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1237 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:11.391669 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e4108509-dcc6-4f3c-a7e0-64e2042be67e tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1273 microversion: 2.1 time: 1.224039 Jul 20 15:32:11.395247 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-352eee4e-2f53-4831-80b5-804fd144a5b6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:11.396270 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-352eee4e-2f53-4831-80b5-804fd144a5b6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:11.414824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-352eee4e-2f53-4831-80b5-804fd144a5b6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:11.415796 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-352eee4e-2f53-4831-80b5-804fd144a5b6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:11.416775 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-352eee4e-2f53-4831-80b5-804fd144a5b6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:11.417369 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-352eee4e-2f53-4831-80b5-804fd144a5b6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:11.456263 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 26/47] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:10 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1273 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:12.402794 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-04a94f7a-6e5f-4830-a77f-2491d660ee10 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:12.403449 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-04a94f7a-6e5f-4830-a77f-2491d660ee10 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:12.726781 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-04a94f7a-6e5f-4830-a77f-2491d660ee10 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:12.730088 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=19 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:12.741460 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-352eee4e-2f53-4831-80b5-804fd144a5b6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:12.744319 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-04a94f7a-6e5f-4830-a77f-2491d660ee10 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1237 microversion: 2.1 time: 0.346613 Jul 20 15:32:12.763819 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-352eee4e-2f53-4831-80b5-804fd144a5b6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1321 microversion: 2.1 time: 1.377326 Jul 20 15:32:12.764362 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 27/48] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:12 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1237 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:12.765536 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 22/49] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:11 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1321 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:12.807771 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-9b41410b-d9d4-40b2-bd88-a9a141f8f5a6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:12.811850 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-9b41410b-d9d4-40b2-bd88-a9a141f8f5a6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:12.839357 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=2 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:12.856328 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9b41410b-d9d4-40b2-bd88-a9a141f8f5a6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:12.856777 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9b41410b-d9d4-40b2-bd88-a9a141f8f5a6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:12.861878 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9b41410b-d9d4-40b2-bd88-a9a141f8f5a6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:12.863992 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9b41410b-d9d4-40b2-bd88-a9a141f8f5a6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:13.100610 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d078c054-7d3c-426e-9f75-c395d0f14799 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-450454418", "imageRef": "80914b1c-623c-42a8-810e-836b2cce0d3b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f5eb24be-2bbb-47ab-b680-70a114f8f10e"}], "security_groups": [{"name": "tempest-securitygroup--888097469"}], "key_name": "tempest-keypair-1394049907", "user_data": "}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:32:13.421852 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-9b41410b-d9d4-40b2-bd88-a9a141f8f5a6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:13.437298 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-9b41410b-d9d4-40b2-bd88-a9a141f8f5a6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1315 microversion: 2.1 time: 0.669914 Jul 20 15:32:13.438946 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 28/50] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:12 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1315 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:13.510581 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.network.neutron [None req-d078c054-7d3c-426e-9f75-c395d0f14799 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] validate_networks() for [('f5eb24be-2bbb-47ab-b680-70a114f8f10e', None, None, None, None, None)] {{(pid=124712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 15:32:13.931404 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-788c6cd7-53a2-4aae-9afa-3a91a2836ddc req-6e650aa1-4942-47ef-bd5c-4a43ecce1d4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b8fe888-a3ab-4889-a5d5-f11697f7c352", "tag": "4b72a20e-3358-46f1-aef8-ee2cf0cabcd7"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:32:13.949918 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=5 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:13.998940 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-788c6cd7-53a2-4aae-9afa-3a91a2836ddc req-6e650aa1-4942-47ef-bd5c-4a43ecce1d4c service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:14.023609 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-788c6cd7-53a2-4aae-9afa-3a91a2836ddc req-6e650aa1-4942-47ef-bd5c-4a43ecce1d4c service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:14.090700 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-788c6cd7-53a2-4aae-9afa-3a91a2836ddc req-6e650aa1-4942-47ef-bd5c-4a43ecce1d4c service nova] Creating event network-changed:4b72a20e-3358-46f1-aef8-ee2cf0cabcd7 for instance 9b8fe888-a3ab-4889-a5d5-f11697f7c352 on hv-cinder-81914 Jul 20 15:32:14.091894 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-788c6cd7-53a2-4aae-9afa-3a91a2836ddc req-6e650aa1-4942-47ef-bd5c-4a43ecce1d4c service nova] Acquired lock "compute-rpcapi-router" {{(pid=124711) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 15:32:14.094485 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3786d9af-e37e-4bbe-b4c6-b69e1c7a5d97 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:14.095150 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3786d9af-e37e-4bbe-b4c6-b69e1c7a5d97 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:14.096304 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3786d9af-e37e-4bbe-b4c6-b69e1c7a5d97 None None] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:14.098069 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3786d9af-e37e-4bbe-b4c6-b69e1c7a5d97 None None] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:14.143763 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.compute.rpcapi [None req-3786d9af-e37e-4bbe-b4c6-b69e1c7a5d97 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 15:32:14.147292 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3786d9af-e37e-4bbe-b4c6-b69e1c7a5d97 None None] Releasing lock "compute-rpcapi-router" {{(pid=124711) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 15:32:14.227137 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-3786d9af-e37e-4bbe-b4c6-b69e1c7a5d97 None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.786446 Jul 20 15:32:14.227801 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 29/51] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:32:14.240755 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-79e5d172-6eaf-45b8-85ec-133d851fba85 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:14.243993 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-79e5d172-6eaf-45b8-85ec-133d851fba85 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:14.259682 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-79e5d172-6eaf-45b8-85ec-133d851fba85 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:14.260140 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-79e5d172-6eaf-45b8-85ec-133d851fba85 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:14.260931 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-79e5d172-6eaf-45b8-85ec-133d851fba85 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:14.261366 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-79e5d172-6eaf-45b8-85ec-133d851fba85 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:14.485178 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-79e5d172-6eaf-45b8-85ec-133d851fba85 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:14.498694 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-79e5d172-6eaf-45b8-85ec-133d851fba85 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1233 microversion: 2.1 time: 0.267761 Jul 20 15:32:14.499628 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 30/52] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:14 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1233 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:14.504438 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-dc6e9747-aea0-4286-81f1-634d9ea47424 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:14.511276 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-dc6e9747-aea0-4286-81f1-634d9ea47424 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:14.528301 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dc6e9747-aea0-4286-81f1-634d9ea47424 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:14.528774 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dc6e9747-aea0-4286-81f1-634d9ea47424 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:14.529545 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dc6e9747-aea0-4286-81f1-634d9ea47424 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:14.529989 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dc6e9747-aea0-4286-81f1-634d9ea47424 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:15.076900 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-dc6e9747-aea0-4286-81f1-634d9ea47424 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:15.091036 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-dc6e9747-aea0-4286-81f1-634d9ea47424 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1321 microversion: 2.1 time: 0.590058 Jul 20 15:32:15.091889 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 31/53] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:14 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1321 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:15.106388 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-71b93f3a-2499-4fe1-80dc-c0eb7f659dd8 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:15.110420 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-71b93f3a-2499-4fe1-80dc-c0eb7f659dd8 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:15.116829 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-d078c054-7d3c-426e-9f75-c395d0f14799 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Flavor limits 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 15:32:15.117816 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-d078c054-7d3c-426e-9f75-c395d0f14799 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Image limits 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 15:32:15.119206 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-d078c054-7d3c-426e-9f75-c395d0f14799 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Flavor pref 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 15:32:15.119824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-d078c054-7d3c-426e-9f75-c395d0f14799 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Image pref 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 15:32:15.120428 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-d078c054-7d3c-426e-9f75-c395d0f14799 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 15:32:15.142571 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-71b93f3a-2499-4fe1-80dc-c0eb7f659dd8 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:15.144629 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d078c054-7d3c-426e-9f75-c395d0f14799 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:15.145536 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-71b93f3a-2499-4fe1-80dc-c0eb7f659dd8 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:15.147999 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-71b93f3a-2499-4fe1-80dc-c0eb7f659dd8 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:15.149486 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-71b93f3a-2499-4fe1-80dc-c0eb7f659dd8 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:15.152987 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d078c054-7d3c-426e-9f75-c395d0f14799 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:15.156867 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d078c054-7d3c-426e-9f75-c395d0f14799 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:15.163440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d078c054-7d3c-426e-9f75-c395d0f14799 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:15.288702 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-d078c054-7d3c-426e-9f75-c395d0f14799 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Getting quotas for project 4446d4a6f4e64ccb8bfd5b3fe6f2127a. Resources: {'instances', 'ram', 'cores'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:32:15.326184 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-d078c054-7d3c-426e-9f75-c395d0f14799 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Getting quotas for user 6498ef5c517c4fa4abed90e430936ded and project 4446d4a6f4e64ccb8bfd5b3fe6f2127a. Resources: {'instances', 'ram', 'cores'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:32:15.410016 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d078c054-7d3c-426e-9f75-c395d0f14799 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Going to run 1 instances... {{(pid=124712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 15:32:15.410016 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d078c054-7d3c-426e-9f75-c395d0f14799 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80914b1c-623c-42a8-810e-836b2cce0d3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 15:32:15.760938 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-d078c054-7d3c-426e-9f75-c395d0f14799 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.655889 Jul 20 15:32:15.768012 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 23/54] 10.222.0.78 () {62 vars in 1187 bytes} [Wed Jul 20 15:32:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 2668 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 15:32:15.789334 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-0afb0da3-df8e-4381-95ce-c91a87aa8a6a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:15.790697 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-0afb0da3-df8e-4381-95ce-c91a87aa8a6a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:15.809734 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0afb0da3-df8e-4381-95ce-c91a87aa8a6a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:15.810955 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0afb0da3-df8e-4381-95ce-c91a87aa8a6a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:15.812762 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0afb0da3-df8e-4381-95ce-c91a87aa8a6a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:15.815332 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0afb0da3-df8e-4381-95ce-c91a87aa8a6a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:16.295856 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-0afb0da3-df8e-4381-95ce-c91a87aa8a6a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:16.310691 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-0afb0da3-df8e-4381-95ce-c91a87aa8a6a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1297 microversion: 2.1 time: 0.541157 Jul 20 15:32:16.311875 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 24/55] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:15 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1297 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:16.344966 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-71b93f3a-2499-4fe1-80dc-c0eb7f659dd8 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:16.364997 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-71b93f3a-2499-4fe1-80dc-c0eb7f659dd8 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1315 microversion: 2.1 time: 1.262809 Jul 20 15:32:16.366650 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 32/56] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:15 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1315 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:16.405815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-f110296f-de19-4263-a0be-c6b76d33dd20 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:16.407494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-f110296f-de19-4263-a0be-c6b76d33dd20 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:16.685820 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-512a9b86-81e7-48cc-b246-87b6807ce953 req-9f4a4e4b-a2b6-4984-a02e-780533995b8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0e200ad-ac34-4618-9518-9cc89ec380de", "tag": "b9a62c66-1f34-4d8d-8dcb-53ae32a72875"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:32:16.701168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-f110296f-de19-4263-a0be-c6b76d33dd20 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:16.701720 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-512a9b86-81e7-48cc-b246-87b6807ce953 req-9f4a4e4b-a2b6-4984-a02e-780533995b8c service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:16.702394 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-512a9b86-81e7-48cc-b246-87b6807ce953 req-9f4a4e4b-a2b6-4984-a02e-780533995b8c service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:16.713714 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-f110296f-de19-4263-a0be-c6b76d33dd20 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:16.718606 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-f110296f-de19-4263-a0be-c6b76d33dd20 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:16.724042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-f110296f-de19-4263-a0be-c6b76d33dd20 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1281 microversion: 2.20 time: 0.335819 Jul 20 15:32:16.735499 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 33/57] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:16 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1281 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:32:16.737884 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-3e6e1f01-2ed9-48e3-a135-6ab38058c4da tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:16.738530 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-3e6e1f01-2ed9-48e3-a135-6ab38058c4da tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:16.746718 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-512a9b86-81e7-48cc-b246-87b6807ce953 req-9f4a4e4b-a2b6-4984-a02e-780533995b8c service nova] Creating event network-changed:b9a62c66-1f34-4d8d-8dcb-53ae32a72875 for instance e0e200ad-ac34-4618-9518-9cc89ec380de on hv-cinder-81914 Jul 20 15:32:16.747359 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-512a9b86-81e7-48cc-b246-87b6807ce953 req-9f4a4e4b-a2b6-4984-a02e-780533995b8c service nova] Acquired lock "compute-rpcapi-router" {{(pid=124712) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 15:32:16.749016 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-966cea2b-564b-4517-a10b-51a0a55ac659 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:16.749545 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-966cea2b-564b-4517-a10b-51a0a55ac659 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:16.750617 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-966cea2b-564b-4517-a10b-51a0a55ac659 None None] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:16.751136 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3e6e1f01-2ed9-48e3-a135-6ab38058c4da tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:16.752081 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3e6e1f01-2ed9-48e3-a135-6ab38058c4da tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:16.753304 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3e6e1f01-2ed9-48e3-a135-6ab38058c4da tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:16.754219 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3e6e1f01-2ed9-48e3-a135-6ab38058c4da tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:16.755024 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-966cea2b-564b-4517-a10b-51a0a55ac659 None None] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:16.780999 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.compute.rpcapi [None req-966cea2b-564b-4517-a10b-51a0a55ac659 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 15:32:16.782015 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-966cea2b-564b-4517-a10b-51a0a55ac659 None None] Releasing lock "compute-rpcapi-router" {{(pid=124712) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 15:32:16.829197 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-966cea2b-564b-4517-a10b-51a0a55ac659 None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.515886 Jul 20 15:32:16.829839 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 25/58] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:32:17.273856 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-01aff12e-ac32-4aec-8203-2bc78d8616bc req-abaa1a4f-ed13-4ec8-b740-60e9d43c4333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4629da0b-5da0-4ba3-bb8a-e076cfcbf14d", "tag": "dcafe070-5aa9-45b4-9985-1e779fe02e07"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:32:17.290234 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-3e6e1f01-2ed9-48e3-a135-6ab38058c4da tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:17.301128 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-3e6e1f01-2ed9-48e3-a135-6ab38058c4da tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1321 microversion: 2.1 time: 0.566809 Jul 20 15:32:17.302377 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 34/59] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:16 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1321 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:17.308068 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-01aff12e-ac32-4aec-8203-2bc78d8616bc req-abaa1a4f-ed13-4ec8-b740-60e9d43c4333 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:17.308672 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-01aff12e-ac32-4aec-8203-2bc78d8616bc req-abaa1a4f-ed13-4ec8-b740-60e9d43c4333 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:17.324492 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-01aff12e-ac32-4aec-8203-2bc78d8616bc req-abaa1a4f-ed13-4ec8-b740-60e9d43c4333 service nova] Creating event network-changed:dcafe070-5aa9-45b4-9985-1e779fe02e07 for instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d on hv-cinder-81914 Jul 20 15:32:17.335386 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-01aff12e-ac32-4aec-8203-2bc78d8616bc req-abaa1a4f-ed13-4ec8-b740-60e9d43c4333 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065415 Jul 20 15:32:17.339991 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 26/60] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:32:17.344313 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d3a0c95f-d089-4e1e-94fe-d559d968a3fd tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:17.347425 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-d3a0c95f-d089-4e1e-94fe-d559d968a3fd tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:17.384898 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-35f58b5d-9f7e-4ba4-8641-bf411203700e tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:17.385604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-35f58b5d-9f7e-4ba4-8641-bf411203700e tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:17.389070 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d3a0c95f-d089-4e1e-94fe-d559d968a3fd tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:17.392095 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d3a0c95f-d089-4e1e-94fe-d559d968a3fd tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:17.393203 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d3a0c95f-d089-4e1e-94fe-d559d968a3fd tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:17.396746 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-35f58b5d-9f7e-4ba4-8641-bf411203700e tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:17.403122 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d3a0c95f-d089-4e1e-94fe-d559d968a3fd tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:17.403632 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-35f58b5d-9f7e-4ba4-8641-bf411203700e tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:17.404537 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-35f58b5d-9f7e-4ba4-8641-bf411203700e tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:17.412480 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-35f58b5d-9f7e-4ba4-8641-bf411203700e tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:17.642758 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d3a0c95f-d089-4e1e-94fe-d559d968a3fd tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:17.652182 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d3a0c95f-d089-4e1e-94fe-d559d968a3fd tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1295 microversion: 2.1 time: 0.327361 Jul 20 15:32:17.663993 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 35/61] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:17 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1295 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:32:17.758109 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-eaf944a1-b052-493a-ab92-ef54b2720f47 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:17.759333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-eaf944a1-b052-493a-ab92-ef54b2720f47 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:17.780207 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-eaf944a1-b052-493a-ab92-ef54b2720f47 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:17.782209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-eaf944a1-b052-493a-ab92-ef54b2720f47 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:17.784698 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-eaf944a1-b052-493a-ab92-ef54b2720f47 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:17.784698 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-eaf944a1-b052-493a-ab92-ef54b2720f47 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:17.805030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-35f58b5d-9f7e-4ba4-8641-bf411203700e tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:17.818086 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-35f58b5d-9f7e-4ba4-8641-bf411203700e tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1315 microversion: 2.1 time: 0.436361 Jul 20 15:32:17.820503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 27/62] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:17 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:32:17.946471 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-eaf944a1-b052-493a-ab92-ef54b2720f47 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:17.965025 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-eaf944a1-b052-493a-ab92-ef54b2720f47 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:17.966901 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-eaf944a1-b052-493a-ab92-ef54b2720f47 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:17.985441 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-eaf944a1-b052-493a-ab92-ef54b2720f47 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1285 microversion: 2.20 time: 0.243274 Jul 20 15:32:17.986303 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 36/63] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:17 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1285 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:32:18.321424 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-6d8be3df-ee93-486d-b948-b11ba29f7e6b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:18.327187 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-6d8be3df-ee93-486d-b948-b11ba29f7e6b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:18.332637 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=12 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:18.417490 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6d8be3df-ee93-486d-b948-b11ba29f7e6b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:18.417490 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6d8be3df-ee93-486d-b948-b11ba29f7e6b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:18.417490 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6d8be3df-ee93-486d-b948-b11ba29f7e6b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:18.417490 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6d8be3df-ee93-486d-b948-b11ba29f7e6b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:18.418089 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=39 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:18.625780 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-6d8be3df-ee93-486d-b948-b11ba29f7e6b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:18.638664 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-6d8be3df-ee93-486d-b948-b11ba29f7e6b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1321 microversion: 2.1 time: 0.322672 Jul 20 15:32:18.651333 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 28/64] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:18 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1321 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:18.673529 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e3ad2725-c398-42c0-9e4b-6c5dde5e43e5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:18.673529 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e3ad2725-c398-42c0-9e4b-6c5dde5e43e5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:18.685642 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e3ad2725-c398-42c0-9e4b-6c5dde5e43e5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:18.686147 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e3ad2725-c398-42c0-9e4b-6c5dde5e43e5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:18.686886 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e3ad2725-c398-42c0-9e4b-6c5dde5e43e5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:18.688557 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e3ad2725-c398-42c0-9e4b-6c5dde5e43e5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:18.801712 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e3ad2725-c398-42c0-9e4b-6c5dde5e43e5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:18.801712 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e3ad2725-c398-42c0-9e4b-6c5dde5e43e5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1295 microversion: 2.1 time: 0.111081 Jul 20 15:32:18.801712 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 37/65] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:18 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1295 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:18.844726 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-11a9bef1-a499-43f5-b6e1-5fa1d525410d tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:18.845466 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-11a9bef1-a499-43f5-b6e1-5fa1d525410d tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:18.868130 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-11a9bef1-a499-43f5-b6e1-5fa1d525410d tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:18.879985 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-11a9bef1-a499-43f5-b6e1-5fa1d525410d tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:18.881411 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-11a9bef1-a499-43f5-b6e1-5fa1d525410d tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:18.882065 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-11a9bef1-a499-43f5-b6e1-5fa1d525410d tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:19.017994 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-7fd4ebe7-af70-4ea4-8312-0f3b457a9c02 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:19.018758 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-7fd4ebe7-af70-4ea4-8312-0f3b457a9c02 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:19.027533 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7fd4ebe7-af70-4ea4-8312-0f3b457a9c02 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:19.028324 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7fd4ebe7-af70-4ea4-8312-0f3b457a9c02 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:19.029687 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7fd4ebe7-af70-4ea4-8312-0f3b457a9c02 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:19.030449 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7fd4ebe7-af70-4ea4-8312-0f3b457a9c02 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:19.184310 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-7fd4ebe7-af70-4ea4-8312-0f3b457a9c02 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:19.196062 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-7fd4ebe7-af70-4ea4-8312-0f3b457a9c02 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:19.207265 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-7fd4ebe7-af70-4ea4-8312-0f3b457a9c02 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:19.208503 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-7fd4ebe7-af70-4ea4-8312-0f3b457a9c02 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1285 microversion: 2.20 time: 0.204386 Jul 20 15:32:19.221376 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 38/66] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:19 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1285 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:32:19.238708 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-11a9bef1-a499-43f5-b6e1-5fa1d525410d tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:19.250562 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-11a9bef1-a499-43f5-b6e1-5fa1d525410d tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1315 microversion: 2.1 time: 0.410359 Jul 20 15:32:19.251477 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 29/67] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:18 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1315 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:19.661450 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-4aae41a2-cee3-453b-829e-7a30c628a2ae tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:19.662058 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-4aae41a2-cee3-453b-829e-7a30c628a2ae tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:19.668339 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4aae41a2-cee3-453b-829e-7a30c628a2ae tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:19.668788 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4aae41a2-cee3-453b-829e-7a30c628a2ae tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:19.669555 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4aae41a2-cee3-453b-829e-7a30c628a2ae tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:19.669988 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4aae41a2-cee3-453b-829e-7a30c628a2ae tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:19.812523 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-ef74f6d0-7279-47c2-a8a6-90dcff36acc5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:19.813834 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-ef74f6d0-7279-47c2-a8a6-90dcff36acc5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:19.821446 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ef74f6d0-7279-47c2-a8a6-90dcff36acc5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:19.822290 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ef74f6d0-7279-47c2-a8a6-90dcff36acc5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:19.823313 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ef74f6d0-7279-47c2-a8a6-90dcff36acc5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:19.823961 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ef74f6d0-7279-47c2-a8a6-90dcff36acc5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:19.951096 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-4aae41a2-cee3-453b-829e-7a30c628a2ae tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:19.969149 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-4aae41a2-cee3-453b-829e-7a30c628a2ae tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1321 microversion: 2.1 time: 0.312052 Jul 20 15:32:19.971032 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 39/68] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:19 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:20.070286 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-ef74f6d0-7279-47c2-a8a6-90dcff36acc5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:20.093025 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-ef74f6d0-7279-47c2-a8a6-90dcff36acc5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1363 microversion: 2.1 time: 0.274389 Jul 20 15:32:20.111227 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 30/69] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:19 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1363 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:20.229463 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-dd1fc07d-1967-49e4-9f90-c7f8af847970 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:20.230067 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-dd1fc07d-1967-49e4-9f90-c7f8af847970 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:20.236207 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dd1fc07d-1967-49e4-9f90-c7f8af847970 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:20.236647 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dd1fc07d-1967-49e4-9f90-c7f8af847970 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:20.237394 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dd1fc07d-1967-49e4-9f90-c7f8af847970 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:20.237829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dd1fc07d-1967-49e4-9f90-c7f8af847970 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:20.255752 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=100 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:20.268922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-4a2ee886-64db-4612-bf30-fef1902dbfb3 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:20.270452 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-4a2ee886-64db-4612-bf30-fef1902dbfb3 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:20.277180 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4a2ee886-64db-4612-bf30-fef1902dbfb3 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:20.277627 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4a2ee886-64db-4612-bf30-fef1902dbfb3 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:20.278443 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4a2ee886-64db-4612-bf30-fef1902dbfb3 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:20.278879 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4a2ee886-64db-4612-bf30-fef1902dbfb3 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:20.299738 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-dd1fc07d-1967-49e4-9f90-c7f8af847970 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:20.311114 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-dd1fc07d-1967-49e4-9f90-c7f8af847970 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:20.311114 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-dd1fc07d-1967-49e4-9f90-c7f8af847970 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:20.312814 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-dd1fc07d-1967-49e4-9f90-c7f8af847970 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1277 microversion: 2.20 time: 0.087229 Jul 20 15:32:20.313851 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 40/70] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:20 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:32:20.445704 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4a2ee886-64db-4612-bf30-fef1902dbfb3 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:20.454167 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-4a2ee886-64db-4612-bf30-fef1902dbfb3 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1315 microversion: 2.1 time: 0.189021 Jul 20 15:32:20.454786 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 31/71] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:20 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:32:20.987535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-302b11e7-6506-44eb-a3d9-6fd5cf3c6b23 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:20.988142 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-302b11e7-6506-44eb-a3d9-6fd5cf3c6b23 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:20.994779 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-302b11e7-6506-44eb-a3d9-6fd5cf3c6b23 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:20.995224 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-302b11e7-6506-44eb-a3d9-6fd5cf3c6b23 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:20.996060 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-302b11e7-6506-44eb-a3d9-6fd5cf3c6b23 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:20.996503 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-302b11e7-6506-44eb-a3d9-6fd5cf3c6b23 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:21.128483 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b1f81c18-9458-45bb-bb61-71358988b6a1 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:21.130025 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b1f81c18-9458-45bb-bb61-71358988b6a1 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:21.132013 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-302b11e7-6506-44eb-a3d9-6fd5cf3c6b23 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:21.135879 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b1f81c18-9458-45bb-bb61-71358988b6a1 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:21.136333 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b1f81c18-9458-45bb-bb61-71358988b6a1 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:21.137225 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b1f81c18-9458-45bb-bb61-71358988b6a1 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:21.137622 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b1f81c18-9458-45bb-bb61-71358988b6a1 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:21.140093 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-302b11e7-6506-44eb-a3d9-6fd5cf3c6b23 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1321 microversion: 2.1 time: 0.156301 Jul 20 15:32:21.140832 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 41/72] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:20 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:21.272420 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b1f81c18-9458-45bb-bb61-71358988b6a1 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:21.280263 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b1f81c18-9458-45bb-bb61-71358988b6a1 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1363 microversion: 2.1 time: 0.156622 Jul 20 15:32:21.280852 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 32/73] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:21 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:32:21.330756 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-2eb237f1-f8b2-4546-a69a-7ce559040135 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:21.331362 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-2eb237f1-f8b2-4546-a69a-7ce559040135 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:21.337558 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2eb237f1-f8b2-4546-a69a-7ce559040135 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:21.337994 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2eb237f1-f8b2-4546-a69a-7ce559040135 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:21.338972 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2eb237f1-f8b2-4546-a69a-7ce559040135 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:21.339353 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2eb237f1-f8b2-4546-a69a-7ce559040135 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:21.412888 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2eb237f1-f8b2-4546-a69a-7ce559040135 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:21.421375 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2eb237f1-f8b2-4546-a69a-7ce559040135 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:21.426019 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2eb237f1-f8b2-4546-a69a-7ce559040135 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:21.426019 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-2eb237f1-f8b2-4546-a69a-7ce559040135 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1277 microversion: 2.20 time: 0.097267 Jul 20 15:32:21.426019 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 42/74] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:21 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1277 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:32:21.471975 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e2fcb89b-5696-4b6c-9e0d-951838634e3a tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:21.472573 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e2fcb89b-5696-4b6c-9e0d-951838634e3a tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:21.479165 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e2fcb89b-5696-4b6c-9e0d-951838634e3a tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:21.479599 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e2fcb89b-5696-4b6c-9e0d-951838634e3a tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:21.480346 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e2fcb89b-5696-4b6c-9e0d-951838634e3a tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:21.480771 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e2fcb89b-5696-4b6c-9e0d-951838634e3a tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:21.634286 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-e2fcb89b-5696-4b6c-9e0d-951838634e3a tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:21.646110 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-e2fcb89b-5696-4b6c-9e0d-951838634e3a tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1315 microversion: 2.1 time: 0.177634 Jul 20 15:32:21.647209 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 33/75] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:21 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:22.158038 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-627e1413-8420-407c-9e0d-209458335dd8 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:22.158691 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-627e1413-8420-407c-9e0d-209458335dd8 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:22.164888 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-627e1413-8420-407c-9e0d-209458335dd8 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:22.165340 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-627e1413-8420-407c-9e0d-209458335dd8 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:22.166102 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-627e1413-8420-407c-9e0d-209458335dd8 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:22.166564 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-627e1413-8420-407c-9e0d-209458335dd8 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:22.296760 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-0da088a8-eddc-4170-b9ec-f73ea167f50a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:22.298506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-0da088a8-eddc-4170-b9ec-f73ea167f50a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:22.310667 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-627e1413-8420-407c-9e0d-209458335dd8 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:22.318056 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0da088a8-eddc-4170-b9ec-f73ea167f50a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:22.318490 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-627e1413-8420-407c-9e0d-209458335dd8 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1321 microversion: 2.1 time: 0.164491 Jul 20 15:32:22.318583 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0da088a8-eddc-4170-b9ec-f73ea167f50a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:22.326201 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 43/76] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:22 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:22.326362 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0da088a8-eddc-4170-b9ec-f73ea167f50a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:22.326362 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0da088a8-eddc-4170-b9ec-f73ea167f50a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:22.442077 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-6b1731c5-02d2-4ed2-82f8-43d29c30a3a8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:22.452047 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-6b1731c5-02d2-4ed2-82f8-43d29c30a3a8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:22.452047 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6b1731c5-02d2-4ed2-82f8-43d29c30a3a8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:22.452047 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6b1731c5-02d2-4ed2-82f8-43d29c30a3a8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:22.452047 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6b1731c5-02d2-4ed2-82f8-43d29c30a3a8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:22.452431 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6b1731c5-02d2-4ed2-82f8-43d29c30a3a8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:22.464038 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-0da088a8-eddc-4170-b9ec-f73ea167f50a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:22.476967 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-0da088a8-eddc-4170-b9ec-f73ea167f50a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1363 microversion: 2.1 time: 0.183729 Jul 20 15:32:22.477754 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 34/77] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:22 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:22.519749 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-6b1731c5-02d2-4ed2-82f8-43d29c30a3a8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:22.527642 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-6b1731c5-02d2-4ed2-82f8-43d29c30a3a8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:22.529229 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-6b1731c5-02d2-4ed2-82f8-43d29c30a3a8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:22.530331 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-6b1731c5-02d2-4ed2-82f8-43d29c30a3a8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1277 microversion: 2.20 time: 0.092276 Jul 20 15:32:22.530890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 44/78] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:22 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:32:22.667531 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-9db9201f-9c92-4005-963b-18e07ec0b316 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:22.669860 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-9db9201f-9c92-4005-963b-18e07ec0b316 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:22.674800 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9db9201f-9c92-4005-963b-18e07ec0b316 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:22.675258 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9db9201f-9c92-4005-963b-18e07ec0b316 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:22.676047 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9db9201f-9c92-4005-963b-18e07ec0b316 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:22.676567 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9db9201f-9c92-4005-963b-18e07ec0b316 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:22.810750 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-9db9201f-9c92-4005-963b-18e07ec0b316 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:22.818106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-9db9201f-9c92-4005-963b-18e07ec0b316 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1315 microversion: 2.1 time: 0.157438 Jul 20 15:32:22.818704 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 35/79] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:22 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:23.343429 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-190cbe6d-eedd-4e4b-a6bd-3c9a2eb57914 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:23.343429 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-190cbe6d-eedd-4e4b-a6bd-3c9a2eb57914 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:23.349960 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-190cbe6d-eedd-4e4b-a6bd-3c9a2eb57914 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:23.350372 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-190cbe6d-eedd-4e4b-a6bd-3c9a2eb57914 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:23.356012 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-190cbe6d-eedd-4e4b-a6bd-3c9a2eb57914 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:23.356012 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-190cbe6d-eedd-4e4b-a6bd-3c9a2eb57914 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:23.486814 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-190cbe6d-eedd-4e4b-a6bd-3c9a2eb57914 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:23.496001 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d8115a35-d0a2-4598-9cf5-cfcc62c0a255 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:23.496722 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d8115a35-d0a2-4598-9cf5-cfcc62c0a255 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:23.498113 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-190cbe6d-eedd-4e4b-a6bd-3c9a2eb57914 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1321 microversion: 2.1 time: 0.161010 Jul 20 15:32:23.498744 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 45/80] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:23 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:23.509138 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d8115a35-d0a2-4598-9cf5-cfcc62c0a255 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:23.511569 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d8115a35-d0a2-4598-9cf5-cfcc62c0a255 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:23.512739 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d8115a35-d0a2-4598-9cf5-cfcc62c0a255 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:23.513191 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d8115a35-d0a2-4598-9cf5-cfcc62c0a255 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:23.548081 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-fc8ac01a-46a1-4744-ac9e-26e512b88812 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:23.548847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-fc8ac01a-46a1-4744-ac9e-26e512b88812 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:23.555622 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fc8ac01a-46a1-4744-ac9e-26e512b88812 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:23.556425 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fc8ac01a-46a1-4744-ac9e-26e512b88812 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:23.557426 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fc8ac01a-46a1-4744-ac9e-26e512b88812 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:23.558066 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fc8ac01a-46a1-4744-ac9e-26e512b88812 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:23.686172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-fc8ac01a-46a1-4744-ac9e-26e512b88812 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:23.702033 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-fc8ac01a-46a1-4744-ac9e-26e512b88812 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:23.705212 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-fc8ac01a-46a1-4744-ac9e-26e512b88812 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:23.706828 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-fc8ac01a-46a1-4744-ac9e-26e512b88812 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1277 microversion: 2.20 time: 0.162948 Jul 20 15:32:23.719123 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 46/81] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:23 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:32:23.740091 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d8115a35-d0a2-4598-9cf5-cfcc62c0a255 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:23.755771 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-d8115a35-d0a2-4598-9cf5-cfcc62c0a255 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1363 microversion: 2.1 time: 0.264987 Jul 20 15:32:23.768648 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 36/82] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:23 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:23.835534 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-2155346b-711d-4579-b0ab-b9e1595d2c53 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:23.836436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-2155346b-711d-4579-b0ab-b9e1595d2c53 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:23.844144 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2155346b-711d-4579-b0ab-b9e1595d2c53 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:23.844968 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2155346b-711d-4579-b0ab-b9e1595d2c53 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:23.845987 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2155346b-711d-4579-b0ab-b9e1595d2c53 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:23.846668 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2155346b-711d-4579-b0ab-b9e1595d2c53 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:23.997953 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2155346b-711d-4579-b0ab-b9e1595d2c53 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:24.005355 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-2155346b-711d-4579-b0ab-b9e1595d2c53 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1315 microversion: 2.1 time: 0.173851 Jul 20 15:32:24.006012 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 47/83] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:23 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:24.487707 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-9746d254-b73b-4da6-8cdd-25fb8af9266a req-73b5e35f-a5d4-42c0-bd68-1357a73bb9f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7693c05d-ad3d-40fb-8c50-56e655ca708a", "tag": "7c61a150-9d0c-4c43-949a-82e85b926581"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:32:24.496329 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-9746d254-b73b-4da6-8cdd-25fb8af9266a req-73b5e35f-a5d4-42c0-bd68-1357a73bb9f1 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:24.496982 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-9746d254-b73b-4da6-8cdd-25fb8af9266a req-73b5e35f-a5d4-42c0-bd68-1357a73bb9f1 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:24.516075 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-9746d254-b73b-4da6-8cdd-25fb8af9266a req-73b5e35f-a5d4-42c0-bd68-1357a73bb9f1 service nova] Creating event network-changed:7c61a150-9d0c-4c43-949a-82e85b926581 for instance 7693c05d-ad3d-40fb-8c50-56e655ca708a on hv-cinder-81914 Jul 20 15:32:24.523593 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-63b37895-0f4b-4c7e-9126-a1b056d9adf9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:24.523593 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-63b37895-0f4b-4c7e-9126-a1b056d9adf9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:24.524430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-9746d254-b73b-4da6-8cdd-25fb8af9266a req-73b5e35f-a5d4-42c0-bd68-1357a73bb9f1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037873 Jul 20 15:32:24.524430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 37/84] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:32:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:32:24.528004 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=2 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:24.531039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-63b37895-0f4b-4c7e-9126-a1b056d9adf9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:24.531858 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-63b37895-0f4b-4c7e-9126-a1b056d9adf9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:24.532688 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-63b37895-0f4b-4c7e-9126-a1b056d9adf9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:24.533429 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-63b37895-0f4b-4c7e-9126-a1b056d9adf9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:24.705970 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-63b37895-0f4b-4c7e-9126-a1b056d9adf9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:24.720032 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-63b37895-0f4b-4c7e-9126-a1b056d9adf9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1321 microversion: 2.1 time: 0.208457 Jul 20 15:32:24.721213 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 48/85] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:24 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:24.727875 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-351b4a99-035d-49f4-81fc-d99d8bc36778 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:24.729220 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-351b4a99-035d-49f4-81fc-d99d8bc36778 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:24.736426 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-351b4a99-035d-49f4-81fc-d99d8bc36778 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:24.736873 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-351b4a99-035d-49f4-81fc-d99d8bc36778 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:24.737671 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-351b4a99-035d-49f4-81fc-d99d8bc36778 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:24.738121 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-351b4a99-035d-49f4-81fc-d99d8bc36778 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:24.773329 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-b9249df0-a82b-4a80-a688-830fe83fd643 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:24.773976 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-b9249df0-a82b-4a80-a688-830fe83fd643 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:24.790977 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b9249df0-a82b-4a80-a688-830fe83fd643 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:24.791497 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b9249df0-a82b-4a80-a688-830fe83fd643 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:24.792345 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b9249df0-a82b-4a80-a688-830fe83fd643 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:24.792799 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b9249df0-a82b-4a80-a688-830fe83fd643 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:24.813100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-351b4a99-035d-49f4-81fc-d99d8bc36778 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:24.821430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-351b4a99-035d-49f4-81fc-d99d8bc36778 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:24.823822 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-351b4a99-035d-49f4-81fc-d99d8bc36778 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:24.825614 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-351b4a99-035d-49f4-81fc-d99d8bc36778 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1333 microversion: 2.20 time: 0.102357 Jul 20 15:32:24.826635 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 38/86] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:24 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1333 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:32:24.950104 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-b9249df0-a82b-4a80-a688-830fe83fd643 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:24.971792 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-b9249df0-a82b-4a80-a688-830fe83fd643 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1363 microversion: 2.1 time: 0.202181 Jul 20 15:32:24.972509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 49/87] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:24 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:25.023498 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d46de601-2941-4184-824e-aa3a4283a7d2 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:25.024112 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d46de601-2941-4184-824e-aa3a4283a7d2 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:25.030588 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d46de601-2941-4184-824e-aa3a4283a7d2 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:25.031030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d46de601-2941-4184-824e-aa3a4283a7d2 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:25.034663 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d46de601-2941-4184-824e-aa3a4283a7d2 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:25.034663 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d46de601-2941-4184-824e-aa3a4283a7d2 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:25.171841 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d46de601-2941-4184-824e-aa3a4283a7d2 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:25.179615 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-d46de601-2941-4184-824e-aa3a4283a7d2 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1315 microversion: 2.1 time: 0.159973 Jul 20 15:32:25.180191 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 39/88] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:25 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:25.739015 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-7cdee154-a4ce-41d6-accb-11dcb598563c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:25.740755 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-7cdee154-a4ce-41d6-accb-11dcb598563c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:25.746498 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7cdee154-a4ce-41d6-accb-11dcb598563c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:25.747015 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7cdee154-a4ce-41d6-accb-11dcb598563c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:25.747777 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7cdee154-a4ce-41d6-accb-11dcb598563c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:25.748208 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7cdee154-a4ce-41d6-accb-11dcb598563c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:25.848745 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b260a031-bdfc-4717-acee-f6fac5b39467 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:25.849346 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b260a031-bdfc-4717-acee-f6fac5b39467 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:25.851653 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=14 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:25.865928 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b260a031-bdfc-4717-acee-f6fac5b39467 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:25.866409 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b260a031-bdfc-4717-acee-f6fac5b39467 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:25.867340 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b260a031-bdfc-4717-acee-f6fac5b39467 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:25.868338 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b260a031-bdfc-4717-acee-f6fac5b39467 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:25.915689 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-7cdee154-a4ce-41d6-accb-11dcb598563c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:25.941138 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-7cdee154-a4ce-41d6-accb-11dcb598563c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1321 microversion: 2.1 time: 0.205245 Jul 20 15:32:25.942992 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 50/89] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:25 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:32:25.959421 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b260a031-bdfc-4717-acee-f6fac5b39467 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:25.969056 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b260a031-bdfc-4717-acee-f6fac5b39467 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:25.970893 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b260a031-bdfc-4717-acee-f6fac5b39467 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:25.972221 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b260a031-bdfc-4717-acee-f6fac5b39467 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1333 microversion: 2.20 time: 0.127296 Jul 20 15:32:25.973486 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 40/90] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:25 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1333 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:32:25.989149 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-a3f15a6d-9e6e-4a85-822a-15b62406ba15 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:25.989882 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-a3f15a6d-9e6e-4a85-822a-15b62406ba15 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:25.996355 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a3f15a6d-9e6e-4a85-822a-15b62406ba15 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:25.998459 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a3f15a6d-9e6e-4a85-822a-15b62406ba15 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:25.998459 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a3f15a6d-9e6e-4a85-822a-15b62406ba15 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:25.998459 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a3f15a6d-9e6e-4a85-822a-15b62406ba15 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:26.171025 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-a3f15a6d-9e6e-4a85-822a-15b62406ba15 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:26.173672 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-a3f15a6d-9e6e-4a85-822a-15b62406ba15 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1363 microversion: 2.1 time: 0.188303 Jul 20 15:32:26.174468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 51/91] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:25 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:26.197304 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-10a9bbd3-8f39-4dd8-9c0e-3919e11d7aa1 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:26.198611 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-10a9bbd3-8f39-4dd8-9c0e-3919e11d7aa1 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:26.209479 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-10a9bbd3-8f39-4dd8-9c0e-3919e11d7aa1 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:26.209479 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-10a9bbd3-8f39-4dd8-9c0e-3919e11d7aa1 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:26.209479 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-10a9bbd3-8f39-4dd8-9c0e-3919e11d7aa1 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:26.209479 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-10a9bbd3-8f39-4dd8-9c0e-3919e11d7aa1 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:26.352410 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-10a9bbd3-8f39-4dd8-9c0e-3919e11d7aa1 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:26.360686 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-10a9bbd3-8f39-4dd8-9c0e-3919e11d7aa1 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1315 microversion: 2.1 time: 0.167619 Jul 20 15:32:26.361460 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 41/92] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:26 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:26.959667 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-00330d55-d079-4379-a141-c46173c41e07 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:26.961084 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-00330d55-d079-4379-a141-c46173c41e07 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:26.961928 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=3 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:26.968123 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-00330d55-d079-4379-a141-c46173c41e07 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:26.968571 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-00330d55-d079-4379-a141-c46173c41e07 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:26.969335 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-00330d55-d079-4379-a141-c46173c41e07 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:26.969766 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-00330d55-d079-4379-a141-c46173c41e07 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:26.991221 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-7d006ffc-e729-45e3-b7e9-6c4e6e5f2bb1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:26.991908 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-7d006ffc-e729-45e3-b7e9-6c4e6e5f2bb1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:26.994057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=6 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:26.999476 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7d006ffc-e729-45e3-b7e9-6c4e6e5f2bb1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:26.999985 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7d006ffc-e729-45e3-b7e9-6c4e6e5f2bb1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:27.000790 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7d006ffc-e729-45e3-b7e9-6c4e6e5f2bb1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:27.001275 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7d006ffc-e729-45e3-b7e9-6c4e6e5f2bb1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:27.094479 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-7d006ffc-e729-45e3-b7e9-6c4e6e5f2bb1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:27.104023 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-7d006ffc-e729-45e3-b7e9-6c4e6e5f2bb1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:27.105851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-7d006ffc-e729-45e3-b7e9-6c4e6e5f2bb1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:27.111815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-7d006ffc-e729-45e3-b7e9-6c4e6e5f2bb1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1333 microversion: 2.20 time: 0.124015 Jul 20 15:32:27.116253 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 42/93] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:26 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1333 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:32:27.143985 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-00330d55-d079-4379-a141-c46173c41e07 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:27.152916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-00330d55-d079-4379-a141-c46173c41e07 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1321 microversion: 2.1 time: 0.197358 Jul 20 15:32:27.153813 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 52/94] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:26 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:27.192257 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-1aedc6d0-6cf7-4713-8437-c9d0f6d181bb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:27.192903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-1aedc6d0-6cf7-4713-8437-c9d0f6d181bb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:27.200657 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1aedc6d0-6cf7-4713-8437-c9d0f6d181bb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:27.201170 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1aedc6d0-6cf7-4713-8437-c9d0f6d181bb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:27.201933 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1aedc6d0-6cf7-4713-8437-c9d0f6d181bb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:27.202456 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1aedc6d0-6cf7-4713-8437-c9d0f6d181bb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:27.355279 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-1aedc6d0-6cf7-4713-8437-c9d0f6d181bb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:27.363287 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-1aedc6d0-6cf7-4713-8437-c9d0f6d181bb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1363 microversion: 2.1 time: 0.174849 Jul 20 15:32:27.363849 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 43/95] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:27 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:27.378396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-3b538e84-e60d-482c-b832-6d202eea2df6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:27.379035 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-3b538e84-e60d-482c-b832-6d202eea2df6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:27.385647 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3b538e84-e60d-482c-b832-6d202eea2df6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:27.386102 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3b538e84-e60d-482c-b832-6d202eea2df6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:27.386902 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3b538e84-e60d-482c-b832-6d202eea2df6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:27.387332 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3b538e84-e60d-482c-b832-6d202eea2df6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:27.568500 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-3b538e84-e60d-482c-b832-6d202eea2df6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:27.577924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-3b538e84-e60d-482c-b832-6d202eea2df6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1315 microversion: 2.1 time: 0.203285 Jul 20 15:32:27.578702 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 53/96] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:27 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:28.133030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-c26d9946-3620-414c-8e8b-390cda23bf32 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:28.133900 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-c26d9946-3620-414c-8e8b-390cda23bf32 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:28.168734 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c26d9946-3620-414c-8e8b-390cda23bf32 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:28.168734 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c26d9946-3620-414c-8e8b-390cda23bf32 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:28.168734 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c26d9946-3620-414c-8e8b-390cda23bf32 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:28.168734 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c26d9946-3620-414c-8e8b-390cda23bf32 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:28.172303 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-927710d8-50b1-4b28-9910-15440703a37d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:28.173197 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-927710d8-50b1-4b28-9910-15440703a37d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:28.183056 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-927710d8-50b1-4b28-9910-15440703a37d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:28.183501 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-927710d8-50b1-4b28-9910-15440703a37d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:28.184362 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-927710d8-50b1-4b28-9910-15440703a37d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:28.184787 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-927710d8-50b1-4b28-9910-15440703a37d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:28.230436 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-c26d9946-3620-414c-8e8b-390cda23bf32 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:28.241413 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-c26d9946-3620-414c-8e8b-390cda23bf32 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:28.243697 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-c26d9946-3620-414c-8e8b-390cda23bf32 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:28.245109 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-c26d9946-3620-414c-8e8b-390cda23bf32 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1333 microversion: 2.20 time: 0.116067 Jul 20 15:32:28.245835 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 44/97] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:28 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1333 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:32:28.370812 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-927710d8-50b1-4b28-9910-15440703a37d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:28.379101 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-927710d8-50b1-4b28-9910-15440703a37d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1321 microversion: 2.1 time: 0.210954 Jul 20 15:32:28.383581 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-6f08e323-984b-4499-9c2a-9f17cfc123e6 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:28.385284 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-6f08e323-984b-4499-9c2a-9f17cfc123e6 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:28.393043 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 54/98] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:28 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:28.396249 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6f08e323-984b-4499-9c2a-9f17cfc123e6 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:28.397151 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6f08e323-984b-4499-9c2a-9f17cfc123e6 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:28.398645 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6f08e323-984b-4499-9c2a-9f17cfc123e6 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:28.399505 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6f08e323-984b-4499-9c2a-9f17cfc123e6 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:28.426590 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=100 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:28.554958 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-6f08e323-984b-4499-9c2a-9f17cfc123e6 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:28.563892 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-6f08e323-984b-4499-9c2a-9f17cfc123e6 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1363 microversion: 2.1 time: 0.187649 Jul 20 15:32:28.564672 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 45/99] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:28 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:28.596356 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-1e3900f8-450a-454f-8594-275070f34364 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:28.596990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-1e3900f8-450a-454f-8594-275070f34364 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:28.603412 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1e3900f8-450a-454f-8594-275070f34364 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:28.603864 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1e3900f8-450a-454f-8594-275070f34364 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:28.604628 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1e3900f8-450a-454f-8594-275070f34364 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:28.605060 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1e3900f8-450a-454f-8594-275070f34364 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:28.751405 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-1e3900f8-450a-454f-8594-275070f34364 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:28.759194 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-1e3900f8-450a-454f-8594-275070f34364 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1315 microversion: 2.1 time: 0.166749 Jul 20 15:32:28.760261 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 55/100] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:28 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:29.273131 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-2e557147-194c-4cfa-bd01-19e54b31169d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:29.273802 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-2e557147-194c-4cfa-bd01-19e54b31169d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:29.280410 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2e557147-194c-4cfa-bd01-19e54b31169d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:29.280853 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2e557147-194c-4cfa-bd01-19e54b31169d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:29.281602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2e557147-194c-4cfa-bd01-19e54b31169d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:29.282038 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2e557147-194c-4cfa-bd01-19e54b31169d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:29.346342 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-2e557147-194c-4cfa-bd01-19e54b31169d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:29.356025 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-2e557147-194c-4cfa-bd01-19e54b31169d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:29.358398 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-2e557147-194c-4cfa-bd01-19e54b31169d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:29.358648 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-2e557147-194c-4cfa-bd01-19e54b31169d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1333 microversion: 2.20 time: 0.089406 Jul 20 15:32:29.359190 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 46/101] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:29 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1333 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:32:29.396215 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-2e8c36ea-9652-4c3b-a39f-9571bc8e9461 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:29.401338 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-2e8c36ea-9652-4c3b-a39f-9571bc8e9461 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:29.403225 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2e8c36ea-9652-4c3b-a39f-9571bc8e9461 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:29.403772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2e8c36ea-9652-4c3b-a39f-9571bc8e9461 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:29.404539 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2e8c36ea-9652-4c3b-a39f-9571bc8e9461 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:29.404974 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2e8c36ea-9652-4c3b-a39f-9571bc8e9461 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:29.544100 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2e8c36ea-9652-4c3b-a39f-9571bc8e9461 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:29.551778 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-2e8c36ea-9652-4c3b-a39f-9571bc8e9461 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1321 microversion: 2.1 time: 0.159335 Jul 20 15:32:29.552349 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 56/102] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:29 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:29.582698 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-6692659f-225b-4eb7-ad98-c25816f3ed72 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:29.583336 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-6692659f-225b-4eb7-ad98-c25816f3ed72 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:29.589765 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6692659f-225b-4eb7-ad98-c25816f3ed72 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:29.590203 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6692659f-225b-4eb7-ad98-c25816f3ed72 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:29.592244 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6692659f-225b-4eb7-ad98-c25816f3ed72 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:29.592244 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6692659f-225b-4eb7-ad98-c25816f3ed72 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:29.742731 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-6692659f-225b-4eb7-ad98-c25816f3ed72 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:29.750906 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-6692659f-225b-4eb7-ad98-c25816f3ed72 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1363 microversion: 2.1 time: 0.172508 Jul 20 15:32:29.751589 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 47/103] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:29 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:29.777456 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-7baa4af6-2cd8-46e9-bc20-291b2347a638 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:29.783907 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-7baa4af6-2cd8-46e9-bc20-291b2347a638 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:29.784318 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7baa4af6-2cd8-46e9-bc20-291b2347a638 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:29.784757 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7baa4af6-2cd8-46e9-bc20-291b2347a638 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:29.785518 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7baa4af6-2cd8-46e9-bc20-291b2347a638 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:29.785944 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7baa4af6-2cd8-46e9-bc20-291b2347a638 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:29.790013 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=100 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:29.922593 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-7baa4af6-2cd8-46e9-bc20-291b2347a638 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:29.929967 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-7baa4af6-2cd8-46e9-bc20-291b2347a638 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1315 microversion: 2.1 time: 0.157048 Jul 20 15:32:29.930569 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 57/104] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:29 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:30.377398 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-94201119-2cdb-463b-a671-8eaf88668570 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:30.378720 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-94201119-2cdb-463b-a671-8eaf88668570 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:30.385810 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-94201119-2cdb-463b-a671-8eaf88668570 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:30.386540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-94201119-2cdb-463b-a671-8eaf88668570 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:30.387556 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-94201119-2cdb-463b-a671-8eaf88668570 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:30.387970 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-94201119-2cdb-463b-a671-8eaf88668570 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:30.455752 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-94201119-2cdb-463b-a671-8eaf88668570 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:30.469739 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-94201119-2cdb-463b-a671-8eaf88668570 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:30.469739 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-94201119-2cdb-463b-a671-8eaf88668570 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:30.469739 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-94201119-2cdb-463b-a671-8eaf88668570 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1333 microversion: 2.20 time: 0.095522 Jul 20 15:32:30.470085 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 48/105] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:30 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1333 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:32:30.568177 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-f0a43638-1d1e-4cdc-8e58-6407a6668ba0 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:30.568803 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-f0a43638-1d1e-4cdc-8e58-6407a6668ba0 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:30.575795 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f0a43638-1d1e-4cdc-8e58-6407a6668ba0 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:30.576245 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f0a43638-1d1e-4cdc-8e58-6407a6668ba0 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:30.577058 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f0a43638-1d1e-4cdc-8e58-6407a6668ba0 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:30.577629 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f0a43638-1d1e-4cdc-8e58-6407a6668ba0 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:30.773548 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-fdac562c-1378-445b-9b96-41ad4d964244 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:30.774771 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-fdac562c-1378-445b-9b96-41ad4d964244 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:30.788015 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fdac562c-1378-445b-9b96-41ad4d964244 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:30.789153 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fdac562c-1378-445b-9b96-41ad4d964244 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:30.792054 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fdac562c-1378-445b-9b96-41ad4d964244 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:30.793137 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fdac562c-1378-445b-9b96-41ad4d964244 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:30.929313 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-f0a43638-1d1e-4cdc-8e58-6407a6668ba0 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:30.936928 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-f0a43638-1d1e-4cdc-8e58-6407a6668ba0 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1321 microversion: 2.1 time: 0.372533 Jul 20 15:32:30.938331 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 58/106] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:30 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1321 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:30.954198 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e1a30a7c-0522-4938-97b0-b94207ca2bac tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:30.954344 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e1a30a7c-0522-4938-97b0-b94207ca2bac tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:30.962908 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e1a30a7c-0522-4938-97b0-b94207ca2bac tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:30.963457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e1a30a7c-0522-4938-97b0-b94207ca2bac tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:30.965207 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e1a30a7c-0522-4938-97b0-b94207ca2bac tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:30.966459 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e1a30a7c-0522-4938-97b0-b94207ca2bac tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:31.030764 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-fdac562c-1378-445b-9b96-41ad4d964244 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:31.041787 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-fdac562c-1378-445b-9b96-41ad4d964244 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1363 microversion: 2.1 time: 0.274469 Jul 20 15:32:31.051288 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 49/107] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:30 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:32:31.180857 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e1a30a7c-0522-4938-97b0-b94207ca2bac tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:31.196178 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e1a30a7c-0522-4938-97b0-b94207ca2bac tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1315 microversion: 2.1 time: 0.247147 Jul 20 15:32:31.197722 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 59/108] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:30 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:32:31.489538 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-acfbac71-1c14-4a9d-a500-223242ef1076 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:31.491425 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-acfbac71-1c14-4a9d-a500-223242ef1076 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:31.518825 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-acfbac71-1c14-4a9d-a500-223242ef1076 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:31.519794 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-acfbac71-1c14-4a9d-a500-223242ef1076 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:31.523160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-acfbac71-1c14-4a9d-a500-223242ef1076 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:31.526844 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-acfbac71-1c14-4a9d-a500-223242ef1076 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:31.708272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-acfbac71-1c14-4a9d-a500-223242ef1076 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:31.723368 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-acfbac71-1c14-4a9d-a500-223242ef1076 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:31.725573 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-acfbac71-1c14-4a9d-a500-223242ef1076 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:31.737233 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-acfbac71-1c14-4a9d-a500-223242ef1076 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1341 microversion: 2.20 time: 0.245164 Jul 20 15:32:31.737233 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 50/109] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:31 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1341 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:32:31.956689 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-287406a1-f694-4d7b-9e39-b2d0b6cfc6f2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:31.957485 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-287406a1-f694-4d7b-9e39-b2d0b6cfc6f2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:31.979441 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-287406a1-f694-4d7b-9e39-b2d0b6cfc6f2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:31.979960 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-287406a1-f694-4d7b-9e39-b2d0b6cfc6f2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:31.980951 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-287406a1-f694-4d7b-9e39-b2d0b6cfc6f2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:31.981578 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-287406a1-f694-4d7b-9e39-b2d0b6cfc6f2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:32.069354 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-6900da04-31dc-4dd5-a84a-0a1363d19d4e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:32.069354 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-6900da04-31dc-4dd5-a84a-0a1363d19d4e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:32.096740 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6900da04-31dc-4dd5-a84a-0a1363d19d4e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:32.099318 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6900da04-31dc-4dd5-a84a-0a1363d19d4e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:32.100937 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6900da04-31dc-4dd5-a84a-0a1363d19d4e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:32.101931 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6900da04-31dc-4dd5-a84a-0a1363d19d4e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:32.227841 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-287406a1-f694-4d7b-9e39-b2d0b6cfc6f2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:32.240241 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-287406a1-f694-4d7b-9e39-b2d0b6cfc6f2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1321 microversion: 2.1 time: 0.287313 Jul 20 15:32:32.241457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 60/110] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:31 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:32.248526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-50565cb9-a125-45d2-8105-9694dc96f785 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:32.249351 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-50565cb9-a125-45d2-8105-9694dc96f785 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:32.273335 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-50565cb9-a125-45d2-8105-9694dc96f785 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:32.274765 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-50565cb9-a125-45d2-8105-9694dc96f785 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:32.276401 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-50565cb9-a125-45d2-8105-9694dc96f785 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:32.278119 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-50565cb9-a125-45d2-8105-9694dc96f785 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:32.456709 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-6900da04-31dc-4dd5-a84a-0a1363d19d4e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:32.472957 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-6900da04-31dc-4dd5-a84a-0a1363d19d4e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1363 microversion: 2.1 time: 0.412814 Jul 20 15:32:32.474782 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 51/111] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:32 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1363 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:32.618701 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-50565cb9-a125-45d2-8105-9694dc96f785 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:32.627579 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-50565cb9-a125-45d2-8105-9694dc96f785 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1315 microversion: 2.1 time: 0.384523 Jul 20 15:32:32.628598 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 61/112] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:32 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1315 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:32.751303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-efe751c2-85c8-4de3-ba5b-9e669bb002bd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:32.752112 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-efe751c2-85c8-4de3-ba5b-9e669bb002bd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:32.759394 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-efe751c2-85c8-4de3-ba5b-9e669bb002bd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:32.760362 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-efe751c2-85c8-4de3-ba5b-9e669bb002bd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:32.761320 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-efe751c2-85c8-4de3-ba5b-9e669bb002bd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:32.761966 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-efe751c2-85c8-4de3-ba5b-9e669bb002bd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:32.855261 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-efe751c2-85c8-4de3-ba5b-9e669bb002bd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:32.869598 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-efe751c2-85c8-4de3-ba5b-9e669bb002bd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:32.875529 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-efe751c2-85c8-4de3-ba5b-9e669bb002bd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:32.878011 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-efe751c2-85c8-4de3-ba5b-9e669bb002bd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1339 microversion: 2.20 time: 0.129634 Jul 20 15:32:32.878772 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 52/113] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:32 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1339 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:32:33.259446 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5c333539-6bf0-49a6-9a73-0279e0b79924 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:33.260655 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5c333539-6bf0-49a6-9a73-0279e0b79924 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:33.276295 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5c333539-6bf0-49a6-9a73-0279e0b79924 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:33.285426 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5c333539-6bf0-49a6-9a73-0279e0b79924 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:33.289335 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5c333539-6bf0-49a6-9a73-0279e0b79924 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:33.291977 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5c333539-6bf0-49a6-9a73-0279e0b79924 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:33.498698 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-1c599252-47ee-4743-ab05-adf12e67bdf1 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:33.501853 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-1c599252-47ee-4743-ab05-adf12e67bdf1 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:33.521578 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1c599252-47ee-4743-ab05-adf12e67bdf1 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:33.525379 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1c599252-47ee-4743-ab05-adf12e67bdf1 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:33.527642 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1c599252-47ee-4743-ab05-adf12e67bdf1 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:33.529254 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1c599252-47ee-4743-ab05-adf12e67bdf1 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:33.831915 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5c333539-6bf0-49a6-9a73-0279e0b79924 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:33.845852 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5c333539-6bf0-49a6-9a73-0279e0b79924 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1321 microversion: 2.1 time: 0.590215 Jul 20 15:32:33.847830 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 62/114] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:33 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1321 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:33.858828 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-14640024-46e3-4ece-b910-c3a64f32e809 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:33.861046 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-14640024-46e3-4ece-b910-c3a64f32e809 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:33.875816 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-14640024-46e3-4ece-b910-c3a64f32e809 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:33.879111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-14640024-46e3-4ece-b910-c3a64f32e809 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:33.885082 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-14640024-46e3-4ece-b910-c3a64f32e809 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:33.885642 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-14640024-46e3-4ece-b910-c3a64f32e809 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:33.929056 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-1c599252-47ee-4743-ab05-adf12e67bdf1 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:33.949776 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-1c599252-47ee-4743-ab05-adf12e67bdf1 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1363 microversion: 2.1 time: 0.460261 Jul 20 15:32:33.957653 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 53/115] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:33 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1363 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:33.970774 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-07a2ff77-72ef-4d57-8595-f5dbe4d34963 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:33.977036 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-07a2ff77-72ef-4d57-8595-f5dbe4d34963 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:33.992661 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-07a2ff77-72ef-4d57-8595-f5dbe4d34963 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:33.997287 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-07a2ff77-72ef-4d57-8595-f5dbe4d34963 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:33.997287 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-07a2ff77-72ef-4d57-8595-f5dbe4d34963 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:34.000041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-07a2ff77-72ef-4d57-8595-f5dbe4d34963 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:34.138591 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-14640024-46e3-4ece-b910-c3a64f32e809 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:34.153175 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-14640024-46e3-4ece-b910-c3a64f32e809 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1315 microversion: 2.1 time: 0.304264 Jul 20 15:32:34.155101 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 63/116] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:33 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:34.377180 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-07a2ff77-72ef-4d57-8595-f5dbe4d34963 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:34.423805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-07a2ff77-72ef-4d57-8595-f5dbe4d34963 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:34.429490 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-07a2ff77-72ef-4d57-8595-f5dbe4d34963 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:34.432445 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-07a2ff77-72ef-4d57-8595-f5dbe4d34963 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1406 microversion: 2.20 time: 0.472654 Jul 20 15:32:34.433458 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 54/117] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:33 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1406 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:32:34.695303 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-5766d571-b044-462b-9fdf-b5cd670bf49c req-60fd2e09-9d95-4f04-83b4-d697264d3a6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4cd0f35-70ba-409d-b217-32d5a9ab6cd6", "tag": "59e14bde-8d7e-43e1-8cdf-acd276b65784"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:32:34.713854 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-5766d571-b044-462b-9fdf-b5cd670bf49c req-60fd2e09-9d95-4f04-83b4-d697264d3a6c service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:34.714568 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-5766d571-b044-462b-9fdf-b5cd670bf49c req-60fd2e09-9d95-4f04-83b4-d697264d3a6c service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:34.729451 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-5766d571-b044-462b-9fdf-b5cd670bf49c req-60fd2e09-9d95-4f04-83b4-d697264d3a6c service nova] Creating event network-changed:59e14bde-8d7e-43e1-8cdf-acd276b65784 for instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 on hv-cinder-81914 Jul 20 15:32:34.734911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-5766d571-b044-462b-9fdf-b5cd670bf49c req-60fd2e09-9d95-4f04-83b4-d697264d3a6c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043271 Jul 20 15:32:34.735641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 64/118] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:32:34.868261 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-c2f119f0-64c3-4c0b-8275-c0b39d38d2b9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:34.868914 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-c2f119f0-64c3-4c0b-8275-c0b39d38d2b9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:34.881566 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c2f119f0-64c3-4c0b-8275-c0b39d38d2b9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:34.882067 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c2f119f0-64c3-4c0b-8275-c0b39d38d2b9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:34.883054 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c2f119f0-64c3-4c0b-8275-c0b39d38d2b9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:34.883649 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c2f119f0-64c3-4c0b-8275-c0b39d38d2b9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:34.980470 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-8ad87fa6-c5f2-41fe-b5fb-c6e57e648224 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:34.981486 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-8ad87fa6-c5f2-41fe-b5fb-c6e57e648224 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:34.992788 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8ad87fa6-c5f2-41fe-b5fb-c6e57e648224 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:34.993543 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8ad87fa6-c5f2-41fe-b5fb-c6e57e648224 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:34.996320 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8ad87fa6-c5f2-41fe-b5fb-c6e57e648224 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:34.999929 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8ad87fa6-c5f2-41fe-b5fb-c6e57e648224 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:35.483217 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-c2f119f0-64c3-4c0b-8275-c0b39d38d2b9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:35.495069 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-c2f119f0-64c3-4c0b-8275-c0b39d38d2b9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1321 microversion: 2.1 time: 0.631289 Jul 20 15:32:35.497302 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 55/119] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:34 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1321 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:32:35.503395 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d3ca255c-f88d-4235-9064-661cd7eb07d5 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:35.504465 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d3ca255c-f88d-4235-9064-661cd7eb07d5 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:35.512024 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d3ca255c-f88d-4235-9064-661cd7eb07d5 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:35.512792 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d3ca255c-f88d-4235-9064-661cd7eb07d5 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:35.513896 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d3ca255c-f88d-4235-9064-661cd7eb07d5 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:35.514574 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d3ca255c-f88d-4235-9064-661cd7eb07d5 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:35.690737 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-8ad87fa6-c5f2-41fe-b5fb-c6e57e648224 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:35.705608 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-8ad87fa6-c5f2-41fe-b5fb-c6e57e648224 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1363 microversion: 2.1 time: 0.733013 Jul 20 15:32:35.707757 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 65/120] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:34 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1363 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:35.713366 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-7b912805-c6fb-4508-8804-316bbe4271b1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:35.714219 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-7b912805-c6fb-4508-8804-316bbe4271b1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:35.722050 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7b912805-c6fb-4508-8804-316bbe4271b1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:35.722549 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7b912805-c6fb-4508-8804-316bbe4271b1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:35.723316 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7b912805-c6fb-4508-8804-316bbe4271b1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:35.724028 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7b912805-c6fb-4508-8804-316bbe4271b1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:35.855841 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d3ca255c-f88d-4235-9064-661cd7eb07d5 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:35.867427 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-d3ca255c-f88d-4235-9064-661cd7eb07d5 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1315 microversion: 2.1 time: 0.368339 Jul 20 15:32:35.868806 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 56/121] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:35 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1315 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:36.007949 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-7b912805-c6fb-4508-8804-316bbe4271b1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:36.044312 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-7b912805-c6fb-4508-8804-316bbe4271b1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:36.048625 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-7b912805-c6fb-4508-8804-316bbe4271b1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:36.051340 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-7b912805-c6fb-4508-8804-316bbe4271b1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1406 microversion: 2.20 time: 0.342091 Jul 20 15:32:36.052939 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 66/122] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:35 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1406 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:32:36.535916 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-6846b40e-604a-43e4-9d8b-ddb8c8f2b671 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:36.535916 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-6846b40e-604a-43e4-9d8b-ddb8c8f2b671 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:36.540210 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6846b40e-604a-43e4-9d8b-ddb8c8f2b671 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:36.540818 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6846b40e-604a-43e4-9d8b-ddb8c8f2b671 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:36.541773 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6846b40e-604a-43e4-9d8b-ddb8c8f2b671 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:36.542222 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6846b40e-604a-43e4-9d8b-ddb8c8f2b671 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:36.729000 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-24ce1586-c4fc-4b24-ab95-fe32c868608e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:36.730798 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-24ce1586-c4fc-4b24-ab95-fe32c868608e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:36.741169 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-24ce1586-c4fc-4b24-ab95-fe32c868608e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:36.742207 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-24ce1586-c4fc-4b24-ab95-fe32c868608e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:36.744577 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-24ce1586-c4fc-4b24-ab95-fe32c868608e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:36.745319 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-24ce1586-c4fc-4b24-ab95-fe32c868608e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:36.860916 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-6846b40e-604a-43e4-9d8b-ddb8c8f2b671 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:36.877027 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-6846b40e-604a-43e4-9d8b-ddb8c8f2b671 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1321 microversion: 2.1 time: 0.349259 Jul 20 15:32:36.880885 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 57/123] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:36 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1321 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:36.899131 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-4e6e207c-4f37-4ab1-8cbf-1ac47085964c tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:36.899887 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-4e6e207c-4f37-4ab1-8cbf-1ac47085964c tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:36.906545 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4e6e207c-4f37-4ab1-8cbf-1ac47085964c tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:36.907064 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4e6e207c-4f37-4ab1-8cbf-1ac47085964c tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:36.907858 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4e6e207c-4f37-4ab1-8cbf-1ac47085964c tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:36.908289 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4e6e207c-4f37-4ab1-8cbf-1ac47085964c tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:37.184464 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-24ce1586-c4fc-4b24-ab95-fe32c868608e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:37.195316 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-24ce1586-c4fc-4b24-ab95-fe32c868608e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1363 microversion: 2.1 time: 0.473882 Jul 20 15:32:37.196017 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 67/124] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:36 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1363 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:37.244786 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4e6e207c-4f37-4ab1-8cbf-1ac47085964c tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:37.261881 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-4e6e207c-4f37-4ab1-8cbf-1ac47085964c tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1315 microversion: 2.1 time: 0.377706 Jul 20 15:32:37.264357 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 58/125] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:36 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:37.280283 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-acf5514c-999e-4e33-91d4-de37b03c40ee tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:37.281374 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-acf5514c-999e-4e33-91d4-de37b03c40ee tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:37.289905 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-acf5514c-999e-4e33-91d4-de37b03c40ee tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:37.291319 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-acf5514c-999e-4e33-91d4-de37b03c40ee tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:37.292160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-acf5514c-999e-4e33-91d4-de37b03c40ee tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:37.292561 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-acf5514c-999e-4e33-91d4-de37b03c40ee tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:37.298895 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-07b4ce6b-9e50-4e04-a91b-ba84bb8e443f req-ac5b305e-74dd-4209-a6b4-788eed634de7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8fe888-a3ab-4889-a5d5-f11697f7c352", "name": "network-vif-plugged", "status": "completed", "tag": "4b72a20e-3358-46f1-aef8-ee2cf0cabcd7"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:32:37.309138 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-07b4ce6b-9e50-4e04-a91b-ba84bb8e443f req-ac5b305e-74dd-4209-a6b4-788eed634de7 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:37.312008 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-07b4ce6b-9e50-4e04-a91b-ba84bb8e443f req-ac5b305e-74dd-4209-a6b4-788eed634de7 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:37.322385 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-07b4ce6b-9e50-4e04-a91b-ba84bb8e443f req-ac5b305e-74dd-4209-a6b4-788eed634de7 service nova] Creating event network-vif-plugged:4b72a20e-3358-46f1-aef8-ee2cf0cabcd7 for instance 9b8fe888-a3ab-4889-a5d5-f11697f7c352 on hv-cinder-81914 Jul 20 15:32:37.327683 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-07b4ce6b-9e50-4e04-a91b-ba84bb8e443f req-ac5b305e-74dd-4209-a6b4-788eed634de7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129868 Jul 20 15:32:37.328330 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 68/126] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:32:37.461225 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-acf5514c-999e-4e33-91d4-de37b03c40ee tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:37.472232 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-acf5514c-999e-4e33-91d4-de37b03c40ee tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:37.474082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-acf5514c-999e-4e33-91d4-de37b03c40ee tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:37.475822 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-acf5514c-999e-4e33-91d4-de37b03c40ee tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1406 microversion: 2.20 time: 0.210158 Jul 20 15:32:37.477426 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 59/127] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:37 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:32:37.901650 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ee77b4ba-9f9d-4656-a2e5-81df68166590 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:37.903683 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ee77b4ba-9f9d-4656-a2e5-81df68166590 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:37.909639 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ee77b4ba-9f9d-4656-a2e5-81df68166590 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:37.910302 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ee77b4ba-9f9d-4656-a2e5-81df68166590 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:37.911249 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ee77b4ba-9f9d-4656-a2e5-81df68166590 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:37.911686 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ee77b4ba-9f9d-4656-a2e5-81df68166590 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:38.109763 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-ee77b4ba-9f9d-4656-a2e5-81df68166590 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:38.123167 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-ee77b4ba-9f9d-4656-a2e5-81df68166590 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1321 microversion: 2.1 time: 0.225426 Jul 20 15:32:38.124450 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 69/128] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:37 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:38.218030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-5b0195f9-53e8-4b17-92a7-e8a130a7d89f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:38.219322 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-5b0195f9-53e8-4b17-92a7-e8a130a7d89f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:38.230311 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5b0195f9-53e8-4b17-92a7-e8a130a7d89f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:38.230696 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5b0195f9-53e8-4b17-92a7-e8a130a7d89f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:38.231520 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5b0195f9-53e8-4b17-92a7-e8a130a7d89f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:38.231955 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5b0195f9-53e8-4b17-92a7-e8a130a7d89f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:38.288327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-59f51c29-acd7-4e47-91c8-41cdc9fd19eb tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:38.289153 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-59f51c29-acd7-4e47-91c8-41cdc9fd19eb tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:38.296625 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-59f51c29-acd7-4e47-91c8-41cdc9fd19eb tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:38.300450 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-59f51c29-acd7-4e47-91c8-41cdc9fd19eb tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:38.300912 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-59f51c29-acd7-4e47-91c8-41cdc9fd19eb tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:38.301544 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-59f51c29-acd7-4e47-91c8-41cdc9fd19eb tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:38.579243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-5b0195f9-53e8-4b17-92a7-e8a130a7d89f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:38.590098 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-5b0195f9-53e8-4b17-92a7-e8a130a7d89f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1363 microversion: 2.1 time: 0.379453 Jul 20 15:32:38.591550 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 60/129] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:38 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1363 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:38.601680 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-5414c6bc-de6b-4883-9966-de4c052c9dcd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:38.609323 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-5414c6bc-de6b-4883-9966-de4c052c9dcd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:38.614358 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5414c6bc-de6b-4883-9966-de4c052c9dcd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:38.619213 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5414c6bc-de6b-4883-9966-de4c052c9dcd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:38.620193 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5414c6bc-de6b-4883-9966-de4c052c9dcd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:38.622656 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5414c6bc-de6b-4883-9966-de4c052c9dcd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:38.637963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-59f51c29-acd7-4e47-91c8-41cdc9fd19eb tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:38.651284 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-59f51c29-acd7-4e47-91c8-41cdc9fd19eb tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1315 microversion: 2.1 time: 0.366682 Jul 20 15:32:38.652138 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 70/130] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:38 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:32:38.879604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-5414c6bc-de6b-4883-9966-de4c052c9dcd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:38.901712 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-5414c6bc-de6b-4883-9966-de4c052c9dcd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:38.910986 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-5414c6bc-de6b-4883-9966-de4c052c9dcd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:38.912178 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-5414c6bc-de6b-4883-9966-de4c052c9dcd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1406 microversion: 2.20 time: 0.318167 Jul 20 15:32:38.912747 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 61/131] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:38 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1406 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:32:39.142646 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-9a12ad0c-50c7-46d3-bd39-c1824f852abb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:39.143416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-9a12ad0c-50c7-46d3-bd39-c1824f852abb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:39.151325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9a12ad0c-50c7-46d3-bd39-c1824f852abb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:39.152291 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9a12ad0c-50c7-46d3-bd39-c1824f852abb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:39.152689 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9a12ad0c-50c7-46d3-bd39-c1824f852abb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:39.152969 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9a12ad0c-50c7-46d3-bd39-c1824f852abb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:39.323575 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-9a12ad0c-50c7-46d3-bd39-c1824f852abb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:39.342762 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-9a12ad0c-50c7-46d3-bd39-c1824f852abb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1321 microversion: 2.1 time: 0.203752 Jul 20 15:32:39.345613 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-35ad6f6c-bee6-4fc2-aee6-61b92cf71047 req-48479164-2ba9-4eca-8bd8-a1b8250cd415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4629da0b-5da0-4ba3-bb8a-e076cfcbf14d", "name": "network-vif-plugged", "status": "completed", "tag": "dcafe070-5aa9-45b4-9985-1e779fe02e07"}, {"server_uuid": "e0e200ad-ac34-4618-9518-9cc89ec380de", "name": "network-vif-plugged", "status": "completed", "tag": "b9a62c66-1f34-4d8d-8dcb-53ae32a72875"}, {"server_uuid": "7693c05d-ad3d-40fb-8c50-56e655ca708a", "name": "network-vif-plugged", "status": "completed", "tag": "7c61a150-9d0c-4c43-949a-82e85b926581"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:32:39.347777 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 71/132] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:39 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:32:39.363342 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-35ad6f6c-bee6-4fc2-aee6-61b92cf71047 req-48479164-2ba9-4eca-8bd8-a1b8250cd415 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:39.363941 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-35ad6f6c-bee6-4fc2-aee6-61b92cf71047 req-48479164-2ba9-4eca-8bd8-a1b8250cd415 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:39.367876 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=100 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:39.378881 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-35ad6f6c-bee6-4fc2-aee6-61b92cf71047 req-48479164-2ba9-4eca-8bd8-a1b8250cd415 service nova] Creating event network-vif-plugged:dcafe070-5aa9-45b4-9985-1e779fe02e07 for instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d on hv-cinder-81914 Jul 20 15:32:39.379568 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-35ad6f6c-bee6-4fc2-aee6-61b92cf71047 req-48479164-2ba9-4eca-8bd8-a1b8250cd415 service nova] Creating event network-vif-plugged:b9a62c66-1f34-4d8d-8dcb-53ae32a72875 for instance e0e200ad-ac34-4618-9518-9cc89ec380de on hv-cinder-81914 Jul 20 15:32:39.380071 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-35ad6f6c-bee6-4fc2-aee6-61b92cf71047 req-48479164-2ba9-4eca-8bd8-a1b8250cd415 service nova] Creating event network-vif-plugged:7c61a150-9d0c-4c43-949a-82e85b926581 for instance 7693c05d-ad3d-40fb-8c50-56e655ca708a on hv-cinder-81914 Jul 20 15:32:39.389281 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-35ad6f6c-bee6-4fc2-aee6-61b92cf71047 req-48479164-2ba9-4eca-8bd8-a1b8250cd415 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.047570 Jul 20 15:32:39.390361 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 62/133] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:32:39.612160 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-9f8da594-5424-47ca-9ff3-59d157a21560 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:39.612910 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-9f8da594-5424-47ca-9ff3-59d157a21560 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:39.620194 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9f8da594-5424-47ca-9ff3-59d157a21560 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:39.620650 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9f8da594-5424-47ca-9ff3-59d157a21560 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:39.621407 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9f8da594-5424-47ca-9ff3-59d157a21560 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:39.622042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9f8da594-5424-47ca-9ff3-59d157a21560 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:39.687261 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-bd3a3ffe-59a5-466d-83b4-257e34a0f699 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:39.688418 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-bd3a3ffe-59a5-466d-83b4-257e34a0f699 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:39.697511 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bd3a3ffe-59a5-466d-83b4-257e34a0f699 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:39.698156 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bd3a3ffe-59a5-466d-83b4-257e34a0f699 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:39.699295 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bd3a3ffe-59a5-466d-83b4-257e34a0f699 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:39.700212 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bd3a3ffe-59a5-466d-83b4-257e34a0f699 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:39.896036 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-9f8da594-5424-47ca-9ff3-59d157a21560 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:39.913108 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-9f8da594-5424-47ca-9ff3-59d157a21560 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1363 microversion: 2.1 time: 0.305720 Jul 20 15:32:39.913878 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 72/134] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:39 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:32:39.930347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-47186380-ee17-45e5-8da0-358c3b1029ce tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:39.931722 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-47186380-ee17-45e5-8da0-358c3b1029ce tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:39.945569 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-47186380-ee17-45e5-8da0-358c3b1029ce tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:39.947608 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-47186380-ee17-45e5-8da0-358c3b1029ce tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:39.948746 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-47186380-ee17-45e5-8da0-358c3b1029ce tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:39.951109 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-47186380-ee17-45e5-8da0-358c3b1029ce tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:40.008425 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-bd3a3ffe-59a5-466d-83b4-257e34a0f699 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:40.018978 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-bd3a3ffe-59a5-466d-83b4-257e34a0f699 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1315 microversion: 2.1 time: 0.339095 Jul 20 15:32:40.020033 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 63/135] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:39 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:40.220269 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-47186380-ee17-45e5-8da0-358c3b1029ce tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:40.233002 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-47186380-ee17-45e5-8da0-358c3b1029ce tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:40.234873 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-47186380-ee17-45e5-8da0-358c3b1029ce tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:40.236157 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-47186380-ee17-45e5-8da0-358c3b1029ce tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1406 microversion: 2.20 time: 0.310392 Jul 20 15:32:40.237197 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 73/136] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:39 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1406 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:32:40.373896 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-cdf726bd-ec84-4306-a4ba-26bd01076cc1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:40.377586 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-cdf726bd-ec84-4306-a4ba-26bd01076cc1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:40.414849 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cdf726bd-ec84-4306-a4ba-26bd01076cc1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:40.418353 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cdf726bd-ec84-4306-a4ba-26bd01076cc1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:40.420683 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cdf726bd-ec84-4306-a4ba-26bd01076cc1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:40.422442 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cdf726bd-ec84-4306-a4ba-26bd01076cc1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:40.690927 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-cdf726bd-ec84-4306-a4ba-26bd01076cc1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:40.706199 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-cdf726bd-ec84-4306-a4ba-26bd01076cc1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1321 microversion: 2.1 time: 0.343246 Jul 20 15:32:40.708067 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 64/137] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:40 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1321 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:40.933887 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-59df8719-9681-4a78-8f6c-23d6e9b07f2b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:40.934684 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-59df8719-9681-4a78-8f6c-23d6e9b07f2b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:40.941038 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-59df8719-9681-4a78-8f6c-23d6e9b07f2b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:40.942329 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-59df8719-9681-4a78-8f6c-23d6e9b07f2b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:40.942698 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-59df8719-9681-4a78-8f6c-23d6e9b07f2b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:40.943125 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-59df8719-9681-4a78-8f6c-23d6e9b07f2b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:41.037927 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-96eb7f40-9d3c-460f-8cfd-5f099d063aa6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:41.039057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-96eb7f40-9d3c-460f-8cfd-5f099d063aa6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:41.049150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-96eb7f40-9d3c-460f-8cfd-5f099d063aa6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:41.052093 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-96eb7f40-9d3c-460f-8cfd-5f099d063aa6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:41.053074 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-96eb7f40-9d3c-460f-8cfd-5f099d063aa6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:41.053792 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-96eb7f40-9d3c-460f-8cfd-5f099d063aa6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:41.137482 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-59df8719-9681-4a78-8f6c-23d6e9b07f2b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:41.142448 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-59df8719-9681-4a78-8f6c-23d6e9b07f2b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1363 microversion: 2.1 time: 0.212983 Jul 20 15:32:41.143760 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 74/138] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:40 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:41.248891 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-96eb7f40-9d3c-460f-8cfd-5f099d063aa6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:41.268367 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-044de7bd-964b-4fe0-8316-df427fce73d5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:41.269681 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-044de7bd-964b-4fe0-8316-df427fce73d5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:41.282446 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-044de7bd-964b-4fe0-8316-df427fce73d5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:41.283416 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-96eb7f40-9d3c-460f-8cfd-5f099d063aa6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1315 microversion: 2.1 time: 0.249154 Jul 20 15:32:41.284142 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-044de7bd-964b-4fe0-8316-df427fce73d5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:41.285951 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-044de7bd-964b-4fe0-8316-df427fce73d5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:41.286391 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 65/139] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:41 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:41.287639 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-044de7bd-964b-4fe0-8316-df427fce73d5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:41.294188 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=100 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:41.503004 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-044de7bd-964b-4fe0-8316-df427fce73d5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:41.517081 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-044de7bd-964b-4fe0-8316-df427fce73d5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:41.518672 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-044de7bd-964b-4fe0-8316-df427fce73d5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:41.519846 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-044de7bd-964b-4fe0-8316-df427fce73d5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1406 microversion: 2.20 time: 0.260789 Jul 20 15:32:41.520397 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 75/140] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:41 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:32:41.724548 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-71e8da44-5a02-47bb-a227-678b46cac4e5 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:41.725761 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-71e8da44-5a02-47bb-a227-678b46cac4e5 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:41.732198 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-71e8da44-5a02-47bb-a227-678b46cac4e5 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:41.732650 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-71e8da44-5a02-47bb-a227-678b46cac4e5 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:41.733445 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-71e8da44-5a02-47bb-a227-678b46cac4e5 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:41.733855 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-71e8da44-5a02-47bb-a227-678b46cac4e5 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:41.908176 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-71e8da44-5a02-47bb-a227-678b46cac4e5 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:41.923844 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-71e8da44-5a02-47bb-a227-678b46cac4e5 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1514 microversion: 2.1 time: 0.200586 Jul 20 15:32:41.924635 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 66/141] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:41 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:41.942303 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-87aeb465-4e61-42e1-8dbf-dc33d0b8add3 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:32:41.943420 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-87aeb465-4e61-42e1-8dbf-dc33d0b8add3 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:41.951119 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-87aeb465-4e61-42e1-8dbf-dc33d0b8add3 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:41.954483 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-87aeb465-4e61-42e1-8dbf-dc33d0b8add3 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:41.956128 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-87aeb465-4e61-42e1-8dbf-dc33d0b8add3 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:41.958304 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-87aeb465-4e61-42e1-8dbf-dc33d0b8add3 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:42.033941 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.objects.instance [None req-87aeb465-4e61-42e1-8dbf-dc33d0b8add3 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lazy-loading 'flavor' on Instance uuid 9b8fe888-a3ab-4889-a5d5-f11697f7c352 {{(pid=124711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:32:42.161277 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-55e16023-860c-4e8a-854c-8e6a28b013ff tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:42.162192 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-55e16023-860c-4e8a-854c-8e6a28b013ff tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:42.169373 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-55e16023-860c-4e8a-854c-8e6a28b013ff tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:42.170227 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-55e16023-860c-4e8a-854c-8e6a28b013ff tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:42.174724 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-55e16023-860c-4e8a-854c-8e6a28b013ff tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:42.175256 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-55e16023-860c-4e8a-854c-8e6a28b013ff tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:42.398117 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-87aeb465-4e61-42e1-8dbf-dc33d0b8add3 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "POST /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352/action" status: 200 len: 32 microversion: 2.1 time: 0.459390 Jul 20 15:32:42.405351 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 76/142] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Jul 20 15:32:41 2022] POST /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352/action => generated 32 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 15:32:42.414340 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d6e5f114-915e-4b7d-a25d-0a42844ab4d6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:42.417083 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-d6e5f114-915e-4b7d-a25d-0a42844ab4d6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:42.429550 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d6e5f114-915e-4b7d-a25d-0a42844ab4d6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:42.430361 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d6e5f114-915e-4b7d-a25d-0a42844ab4d6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:42.432797 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d6e5f114-915e-4b7d-a25d-0a42844ab4d6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:42.434032 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d6e5f114-915e-4b7d-a25d-0a42844ab4d6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:42.515597 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-55e16023-860c-4e8a-854c-8e6a28b013ff tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:42.523076 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-55e16023-860c-4e8a-854c-8e6a28b013ff tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1363 microversion: 2.1 time: 0.365412 Jul 20 15:32:42.524328 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 67/143] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:42 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1363 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:42.533813 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-034010a0-ec11-4fa8-b4a7-ebe3b135e893 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:42.535441 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-034010a0-ec11-4fa8-b4a7-ebe3b135e893 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:42.544891 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-034010a0-ec11-4fa8-b4a7-ebe3b135e893 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:42.545681 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-034010a0-ec11-4fa8-b4a7-ebe3b135e893 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:42.546627 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-034010a0-ec11-4fa8-b4a7-ebe3b135e893 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:42.547501 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-034010a0-ec11-4fa8-b4a7-ebe3b135e893 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:42.901902 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d6e5f114-915e-4b7d-a25d-0a42844ab4d6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:42.922797 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d6e5f114-915e-4b7d-a25d-0a42844ab4d6 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1315 microversion: 2.1 time: 0.515996 Jul 20 15:32:42.923676 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 77/144] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:42 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:42.929612 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-2245b5cd-df1e-4733-9e42-f098acfee12b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:42.932090 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-2245b5cd-df1e-4733-9e42-f098acfee12b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:42.936460 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=100 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:42.956055 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2245b5cd-df1e-4733-9e42-f098acfee12b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:42.956503 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2245b5cd-df1e-4733-9e42-f098acfee12b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:42.957510 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2245b5cd-df1e-4733-9e42-f098acfee12b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:42.957953 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2245b5cd-df1e-4733-9e42-f098acfee12b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:42.985490 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-034010a0-ec11-4fa8-b4a7-ebe3b135e893 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:42.998883 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-034010a0-ec11-4fa8-b4a7-ebe3b135e893 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.472193 Jul 20 15:32:42.999973 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 68/145] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:42 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:43.130629 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2245b5cd-df1e-4733-9e42-f098acfee12b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:43.146023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2245b5cd-df1e-4733-9e42-f098acfee12b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:43.148026 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2245b5cd-df1e-4733-9e42-f098acfee12b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:43.149162 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-2245b5cd-df1e-4733-9e42-f098acfee12b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1406 microversion: 2.20 time: 0.223911 Jul 20 15:32:43.149757 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 78/146] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:42 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:32:43.544165 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-46ca9632-5450-49ae-9201-d8ab3e2a9274 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:43.544769 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-46ca9632-5450-49ae-9201-d8ab3e2a9274 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:43.553817 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-46ca9632-5450-49ae-9201-d8ab3e2a9274 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:43.554781 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-46ca9632-5450-49ae-9201-d8ab3e2a9274 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:43.564732 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-46ca9632-5450-49ae-9201-d8ab3e2a9274 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:43.564732 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-46ca9632-5450-49ae-9201-d8ab3e2a9274 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:43.716543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-46ca9632-5450-49ae-9201-d8ab3e2a9274 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:43.727352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-46ca9632-5450-49ae-9201-d8ab3e2a9274 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1363 microversion: 2.1 time: 0.187278 Jul 20 15:32:43.736375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 69/147] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:43 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:43.943001 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-2fdc7eb6-9fff-4a51-9c26-8b9cdf636de2 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:43.945456 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-2fdc7eb6-9fff-4a51-9c26-8b9cdf636de2 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:43.953950 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2fdc7eb6-9fff-4a51-9c26-8b9cdf636de2 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:43.955069 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2fdc7eb6-9fff-4a51-9c26-8b9cdf636de2 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:43.956089 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2fdc7eb6-9fff-4a51-9c26-8b9cdf636de2 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:43.956853 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2fdc7eb6-9fff-4a51-9c26-8b9cdf636de2 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:44.023672 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-203e6cdd-9323-4d65-9db4-7bf26cdd93b4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:44.024369 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-203e6cdd-9323-4d65-9db4-7bf26cdd93b4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:44.036435 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-203e6cdd-9323-4d65-9db4-7bf26cdd93b4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:44.036891 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-203e6cdd-9323-4d65-9db4-7bf26cdd93b4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:44.037672 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-203e6cdd-9323-4d65-9db4-7bf26cdd93b4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:44.038108 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-203e6cdd-9323-4d65-9db4-7bf26cdd93b4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:44.260595 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2fdc7eb6-9fff-4a51-9c26-8b9cdf636de2 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:44.269466 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-2fdc7eb6-9fff-4a51-9c26-8b9cdf636de2 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1315 microversion: 2.1 time: 0.332525 Jul 20 15:32:44.281101 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 79/148] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:43 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:44.287384 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-6c91f411-96bf-4cfc-a59b-c439b56adee2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:44.288604 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-6c91f411-96bf-4cfc-a59b-c439b56adee2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:44.296978 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-203e6cdd-9323-4d65-9db4-7bf26cdd93b4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:44.297839 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6c91f411-96bf-4cfc-a59b-c439b56adee2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:44.298502 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6c91f411-96bf-4cfc-a59b-c439b56adee2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:44.299720 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6c91f411-96bf-4cfc-a59b-c439b56adee2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:44.300372 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6c91f411-96bf-4cfc-a59b-c439b56adee2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:44.307559 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-203e6cdd-9323-4d65-9db4-7bf26cdd93b4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.287858 Jul 20 15:32:44.311033 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 70/149] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:44 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:44.531675 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-6c91f411-96bf-4cfc-a59b-c439b56adee2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:44.544358 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-6c91f411-96bf-4cfc-a59b-c439b56adee2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:44.546458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-6c91f411-96bf-4cfc-a59b-c439b56adee2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:44.548384 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-6c91f411-96bf-4cfc-a59b-c439b56adee2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1406 microversion: 2.20 time: 0.265816 Jul 20 15:32:44.548960 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 80/150] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:44 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:32:44.754566 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-3f62bbb4-60ef-4a53-b71c-8a4d80bf3a05 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:44.756397 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-3f62bbb4-60ef-4a53-b71c-8a4d80bf3a05 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:44.773354 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3f62bbb4-60ef-4a53-b71c-8a4d80bf3a05 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:44.775327 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3f62bbb4-60ef-4a53-b71c-8a4d80bf3a05 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:44.778769 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3f62bbb4-60ef-4a53-b71c-8a4d80bf3a05 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:44.779247 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3f62bbb4-60ef-4a53-b71c-8a4d80bf3a05 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:44.956574 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-3f62bbb4-60ef-4a53-b71c-8a4d80bf3a05 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:44.968419 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-3f62bbb4-60ef-4a53-b71c-8a4d80bf3a05 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1363 microversion: 2.1 time: 0.226227 Jul 20 15:32:44.969214 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 71/151] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:44 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:45.109105 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-69118d52-1256-40fb-8d26-961368cc18bb req-ceca52dd-2948-46ec-acc1-6b18617dd335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4cd0f35-70ba-409d-b217-32d5a9ab6cd6", "name": "network-vif-plugged", "status": "completed", "tag": "59e14bde-8d7e-43e1-8cdf-acd276b65784"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:32:45.123987 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-69118d52-1256-40fb-8d26-961368cc18bb req-ceca52dd-2948-46ec-acc1-6b18617dd335 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:45.124552 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-69118d52-1256-40fb-8d26-961368cc18bb req-ceca52dd-2948-46ec-acc1-6b18617dd335 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:45.137202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-69118d52-1256-40fb-8d26-961368cc18bb req-ceca52dd-2948-46ec-acc1-6b18617dd335 service nova] Creating event network-vif-plugged:59e14bde-8d7e-43e1-8cdf-acd276b65784 for instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 on hv-cinder-81914 Jul 20 15:32:45.142913 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-69118d52-1256-40fb-8d26-961368cc18bb req-ceca52dd-2948-46ec-acc1-6b18617dd335 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037343 Jul 20 15:32:45.143651 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 81/152] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:32:45.291750 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-1c298da4-defb-48e9-833b-58d3cb8c6279 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:45.292348 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-1c298da4-defb-48e9-833b-58d3cb8c6279 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:45.300809 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1c298da4-defb-48e9-833b-58d3cb8c6279 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:45.301255 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1c298da4-defb-48e9-833b-58d3cb8c6279 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:45.302003 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1c298da4-defb-48e9-833b-58d3cb8c6279 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:45.302467 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1c298da4-defb-48e9-833b-58d3cb8c6279 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:45.332967 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-fb953d5b-03e5-46eb-8f0e-a8a26ae24c51 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:45.333917 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-fb953d5b-03e5-46eb-8f0e-a8a26ae24c51 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:45.354554 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fb953d5b-03e5-46eb-8f0e-a8a26ae24c51 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:45.355374 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fb953d5b-03e5-46eb-8f0e-a8a26ae24c51 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:45.356429 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fb953d5b-03e5-46eb-8f0e-a8a26ae24c51 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:45.357083 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fb953d5b-03e5-46eb-8f0e-a8a26ae24c51 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:45.632983 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-1c298da4-defb-48e9-833b-58d3cb8c6279 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:45.645475 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-1c298da4-defb-48e9-833b-58d3cb8c6279 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1501 microversion: 2.1 time: 0.361737 Jul 20 15:32:45.646943 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 72/153] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:45 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1501 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:45.655734 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-bc163c0f-7fb6-4270-8650-6e62388b7473 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:45.657070 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-bc163c0f-7fb6-4270-8650-6e62388b7473 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:45.664924 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bc163c0f-7fb6-4270-8650-6e62388b7473 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:45.665386 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bc163c0f-7fb6-4270-8650-6e62388b7473 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:45.666142 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bc163c0f-7fb6-4270-8650-6e62388b7473 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:45.666593 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bc163c0f-7fb6-4270-8650-6e62388b7473 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:45.699888 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-fb953d5b-03e5-46eb-8f0e-a8a26ae24c51 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:45.714224 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-fb953d5b-03e5-46eb-8f0e-a8a26ae24c51 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.383671 Jul 20 15:32:45.718813 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 82/154] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:45 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:32:45.834422 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-bc163c0f-7fb6-4270-8650-6e62388b7473 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:45.851043 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-bc163c0f-7fb6-4270-8650-6e62388b7473 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:45.852551 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-bc163c0f-7fb6-4270-8650-6e62388b7473 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:45.854676 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-bc163c0f-7fb6-4270-8650-6e62388b7473 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1406 microversion: 2.20 time: 0.205554 Jul 20 15:32:45.855216 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 73/155] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:45 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:32:45.999230 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d64aff15-f73f-4453-b486-c3a5d41d9e63 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:45.999992 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-d64aff15-f73f-4453-b486-c3a5d41d9e63 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:46.007447 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d64aff15-f73f-4453-b486-c3a5d41d9e63 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:46.007977 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d64aff15-f73f-4453-b486-c3a5d41d9e63 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:46.008969 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d64aff15-f73f-4453-b486-c3a5d41d9e63 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:46.009405 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d64aff15-f73f-4453-b486-c3a5d41d9e63 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:46.207111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d64aff15-f73f-4453-b486-c3a5d41d9e63 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:46.225987 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d64aff15-f73f-4453-b486-c3a5d41d9e63 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1549 microversion: 2.1 time: 0.234445 Jul 20 15:32:46.234222 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 83/156] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:45 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1549 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:46.244042 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-0c080210-e9bf-4220-9d75-c98b9da35e6e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:46.244591 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-0c080210-e9bf-4220-9d75-c98b9da35e6e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:46.252966 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0c080210-e9bf-4220-9d75-c98b9da35e6e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:46.253660 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0c080210-e9bf-4220-9d75-c98b9da35e6e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:46.254635 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0c080210-e9bf-4220-9d75-c98b9da35e6e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:46.255241 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0c080210-e9bf-4220-9d75-c98b9da35e6e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:46.486918 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-0c080210-e9bf-4220-9d75-c98b9da35e6e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.244155 Jul 20 15:32:46.486918 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 74/157] 10.222.0.78 () {58 vars in 1274 bytes} [Wed Jul 20 15:32:46 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a/os-interface => generated 284 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:32:46.736769 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-0dcd90b7-ddca-48bb-9147-544640686ef3 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:46.737631 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-0dcd90b7-ddca-48bb-9147-544640686ef3 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:46.749070 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0dcd90b7-ddca-48bb-9147-544640686ef3 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:46.749802 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0dcd90b7-ddca-48bb-9147-544640686ef3 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:46.750790 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0dcd90b7-ddca-48bb-9147-544640686ef3 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:46.753105 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0dcd90b7-ddca-48bb-9147-544640686ef3 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:46.875429 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-5d3f938d-3d88-4315-bef8-8743f37a656b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:46.876716 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-5d3f938d-3d88-4315-bef8-8743f37a656b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:46.904164 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5d3f938d-3d88-4315-bef8-8743f37a656b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:46.906587 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5d3f938d-3d88-4315-bef8-8743f37a656b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:46.906587 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5d3f938d-3d88-4315-bef8-8743f37a656b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:46.913464 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5d3f938d-3d88-4315-bef8-8743f37a656b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:47.052729 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-0dcd90b7-ddca-48bb-9147-544640686ef3 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:47.061599 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-0dcd90b7-ddca-48bb-9147-544640686ef3 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.329877 Jul 20 15:32:47.074502 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 84/158] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:46 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:47.175337 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-5d3f938d-3d88-4315-bef8-8743f37a656b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:47.187048 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-5d3f938d-3d88-4315-bef8-8743f37a656b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:47.211919 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-5d3f938d-3d88-4315-bef8-8743f37a656b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:47.217791 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-5d3f938d-3d88-4315-bef8-8743f37a656b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1406 microversion: 2.20 time: 0.347945 Jul 20 15:32:47.219490 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 75/159] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:46 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1406 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:32:47.898707 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c332f2e5-1b39-48f5-95e2-d038dbcdd0c5 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "371e9a8e-7b53-43a2-a567-f5a81a2acdfc"}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:32:47.901374 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c332f2e5-1b39-48f5-95e2-d038dbcdd0c5 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:47.911119 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c332f2e5-1b39-48f5-95e2-d038dbcdd0c5 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:47.911749 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c332f2e5-1b39-48f5-95e2-d038dbcdd0c5 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:47.912545 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c332f2e5-1b39-48f5-95e2-d038dbcdd0c5 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:47.912971 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c332f2e5-1b39-48f5-95e2-d038dbcdd0c5 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:48.084571 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-f6c3071d-7599-4b14-ba3c-41df6075a81a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:48.085985 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-f6c3071d-7599-4b14-ba3c-41df6075a81a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:48.098996 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f6c3071d-7599-4b14-ba3c-41df6075a81a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:48.099892 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f6c3071d-7599-4b14-ba3c-41df6075a81a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:48.101199 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f6c3071d-7599-4b14-ba3c-41df6075a81a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:48.101688 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f6c3071d-7599-4b14-ba3c-41df6075a81a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:48.347095 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-f6c3071d-7599-4b14-ba3c-41df6075a81a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:48.356455 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-f6c3071d-7599-4b14-ba3c-41df6075a81a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.279078 Jul 20 15:32:48.380942 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 76/160] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:48 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:48.388191 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-5f82a268-5262-4816-a43b-36e9b25ae498 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:48.389472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-5f82a268-5262-4816-a43b-36e9b25ae498 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:48.398184 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5f82a268-5262-4816-a43b-36e9b25ae498 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:48.398888 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5f82a268-5262-4816-a43b-36e9b25ae498 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:48.401586 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5f82a268-5262-4816-a43b-36e9b25ae498 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:48.405615 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5f82a268-5262-4816-a43b-36e9b25ae498 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:48.582531 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-5f82a268-5262-4816-a43b-36e9b25ae498 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:48.592672 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-5f82a268-5262-4816-a43b-36e9b25ae498 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:48.595900 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-5f82a268-5262-4816-a43b-36e9b25ae498 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:48.597516 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-5f82a268-5262-4816-a43b-36e9b25ae498 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1406 microversion: 2.20 time: 0.215090 Jul 20 15:32:48.598106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 77/161] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:48 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:32:48.921267 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-d12f7380-4688-4fdf-9ac9-ccba0a76c153 req-aeef7f6f-d6f6-45bd-9887-94a5ae041731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7693c05d-ad3d-40fb-8c50-56e655ca708a", "tag": "7c61a150-9d0c-4c43-949a-82e85b926581"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:32:48.927790 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=100 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:48.931969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-d12f7380-4688-4fdf-9ac9-ccba0a76c153 req-aeef7f6f-d6f6-45bd-9887-94a5ae041731 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:48.932713 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-d12f7380-4688-4fdf-9ac9-ccba0a76c153 req-aeef7f6f-d6f6-45bd-9887-94a5ae041731 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:48.948047 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-d12f7380-4688-4fdf-9ac9-ccba0a76c153 req-aeef7f6f-d6f6-45bd-9887-94a5ae041731 service nova] Creating event network-changed:7c61a150-9d0c-4c43-949a-82e85b926581 for instance 7693c05d-ad3d-40fb-8c50-56e655ca708a on hv-cinder-81914 Jul 20 15:32:48.955342 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-d12f7380-4688-4fdf-9ac9-ccba0a76c153 req-aeef7f6f-d6f6-45bd-9887-94a5ae041731 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037170 Jul 20 15:32:48.958144 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 78/162] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:32:49.384830 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-a1c99a76-eb2a-478c-be36-3e6a68284bde tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:49.385874 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-a1c99a76-eb2a-478c-be36-3e6a68284bde tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:49.394706 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a1c99a76-eb2a-478c-be36-3e6a68284bde tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:49.395266 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a1c99a76-eb2a-478c-be36-3e6a68284bde tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:49.396260 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a1c99a76-eb2a-478c-be36-3e6a68284bde tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:49.396751 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a1c99a76-eb2a-478c-be36-3e6a68284bde tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:49.661084 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-a1c99a76-eb2a-478c-be36-3e6a68284bde tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:49.680260 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-a1c99a76-eb2a-478c-be36-3e6a68284bde tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.298564 Jul 20 15:32:49.681196 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 79/163] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:49 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:32:49.693362 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-69458bf1-b26f-4dc3-a846-cbb9a0996eca tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:49.694505 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-69458bf1-b26f-4dc3-a846-cbb9a0996eca tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:49.718590 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-69458bf1-b26f-4dc3-a846-cbb9a0996eca tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:49.719031 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-69458bf1-b26f-4dc3-a846-cbb9a0996eca tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:49.724312 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-69458bf1-b26f-4dc3-a846-cbb9a0996eca tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:49.724312 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-69458bf1-b26f-4dc3-a846-cbb9a0996eca tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:49.727742 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c332f2e5-1b39-48f5-95e2-d038dbcdd0c5 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "POST /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.833160 Jul 20 15:32:49.729240 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 85/164] 10.222.0.78 () {60 vars in 1322 bytes} [Wed Jul 20 15:32:47 2022] POST /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d/os-volume_attachments => generated 194 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:32:49.754991 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=100 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:50.015397 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-69458bf1-b26f-4dc3-a846-cbb9a0996eca tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:50.040640 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-69458bf1-b26f-4dc3-a846-cbb9a0996eca tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:50.042820 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-69458bf1-b26f-4dc3-a846-cbb9a0996eca tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:50.045619 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-69458bf1-b26f-4dc3-a846-cbb9a0996eca tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1406 microversion: 2.20 time: 0.357098 Jul 20 15:32:50.076745 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 80/165] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:49 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1406 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:32:50.702312 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5313e0c7-394e-42b2-a99d-d2f3213f7e1f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:50.703872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5313e0c7-394e-42b2-a99d-d2f3213f7e1f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:50.712663 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5313e0c7-394e-42b2-a99d-d2f3213f7e1f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:50.713141 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5313e0c7-394e-42b2-a99d-d2f3213f7e1f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:50.713960 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5313e0c7-394e-42b2-a99d-d2f3213f7e1f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:50.714542 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5313e0c7-394e-42b2-a99d-d2f3213f7e1f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:50.864177 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5313e0c7-394e-42b2-a99d-d2f3213f7e1f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:50.875971 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5313e0c7-394e-42b2-a99d-d2f3213f7e1f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.180692 Jul 20 15:32:50.876626 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 86/166] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:50 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:51.079531 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-ab5682a5-af70-4e3f-ae9e-4fe642ecfa0e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:51.080157 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-ab5682a5-af70-4e3f-ae9e-4fe642ecfa0e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:51.097556 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ab5682a5-af70-4e3f-ae9e-4fe642ecfa0e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:51.099212 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ab5682a5-af70-4e3f-ae9e-4fe642ecfa0e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:51.100431 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ab5682a5-af70-4e3f-ae9e-4fe642ecfa0e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:51.101204 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ab5682a5-af70-4e3f-ae9e-4fe642ecfa0e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:51.315847 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-ab5682a5-af70-4e3f-ae9e-4fe642ecfa0e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:51.331451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-ab5682a5-af70-4e3f-ae9e-4fe642ecfa0e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:51.334182 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-ab5682a5-af70-4e3f-ae9e-4fe642ecfa0e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:51.336132 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-ab5682a5-af70-4e3f-ae9e-4fe642ecfa0e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1598 microversion: 2.20 time: 0.261013 Jul 20 15:32:51.337072 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 81/167] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:32:51 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1598 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:32:51.362149 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-a69cc3e6-b942-4529-a2aa-05b67ee608f4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:51.363451 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-a69cc3e6-b942-4529-a2aa-05b67ee608f4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:51.371091 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a69cc3e6-b942-4529-a2aa-05b67ee608f4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:51.371590 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a69cc3e6-b942-4529-a2aa-05b67ee608f4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:51.372547 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a69cc3e6-b942-4529-a2aa-05b67ee608f4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:51.373280 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a69cc3e6-b942-4529-a2aa-05b67ee608f4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:51.488680 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-a69cc3e6-b942-4529-a2aa-05b67ee608f4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.132811 Jul 20 15:32:51.489294 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 87/168] 10.222.0.78 () {60 vars in 1315 bytes} [Wed Jul 20 15:32:51 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 15:32:51.894402 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d86de74d-412d-43b3-83a3-e839a3c8a375 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:51.895153 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d86de74d-412d-43b3-83a3-e839a3c8a375 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:51.902148 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d86de74d-412d-43b3-83a3-e839a3c8a375 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:51.902715 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d86de74d-412d-43b3-83a3-e839a3c8a375 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:51.903597 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d86de74d-412d-43b3-83a3-e839a3c8a375 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:51.904161 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d86de74d-412d-43b3-83a3-e839a3c8a375 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:52.135828 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d86de74d-412d-43b3-83a3-e839a3c8a375 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:52.149307 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-d86de74d-412d-43b3-83a3-e839a3c8a375 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.258600 Jul 20 15:32:52.150918 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 82/169] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:51 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:52.987717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-2c95bd77-71c7-487d-a3e5-d63628fe86b4 req-a2acca46-99ab-4901-8241-3f8fd4555dde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4cd0f35-70ba-409d-b217-32d5a9ab6cd6", "tag": "59e14bde-8d7e-43e1-8cdf-acd276b65784"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:32:53.004570 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-2c95bd77-71c7-487d-a3e5-d63628fe86b4 req-a2acca46-99ab-4901-8241-3f8fd4555dde service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:53.004570 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-2c95bd77-71c7-487d-a3e5-d63628fe86b4 req-a2acca46-99ab-4901-8241-3f8fd4555dde service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:53.012889 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-2c95bd77-71c7-487d-a3e5-d63628fe86b4 req-a2acca46-99ab-4901-8241-3f8fd4555dde service nova] Creating event network-changed:59e14bde-8d7e-43e1-8cdf-acd276b65784 for instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 on hv-cinder-81914 Jul 20 15:32:53.018287 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-2c95bd77-71c7-487d-a3e5-d63628fe86b4 req-a2acca46-99ab-4901-8241-3f8fd4555dde service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034768 Jul 20 15:32:53.019126 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 88/170] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:32:53.176839 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-0387e79a-9cbc-41ca-b474-3e394e04259b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:53.183083 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-0387e79a-9cbc-41ca-b474-3e394e04259b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:53.187222 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0387e79a-9cbc-41ca-b474-3e394e04259b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:53.187960 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0387e79a-9cbc-41ca-b474-3e394e04259b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:53.188997 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0387e79a-9cbc-41ca-b474-3e394e04259b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:53.189717 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0387e79a-9cbc-41ca-b474-3e394e04259b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:53.397977 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-0387e79a-9cbc-41ca-b474-3e394e04259b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:53.409621 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-0387e79a-9cbc-41ca-b474-3e394e04259b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.237486 Jul 20 15:32:53.411385 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 83/171] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:53 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:32:54.428978 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-891daf18-b35e-4a90-9f67-f5899bc2fccc tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:54.429686 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-891daf18-b35e-4a90-9f67-f5899bc2fccc tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:54.437591 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-891daf18-b35e-4a90-9f67-f5899bc2fccc tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:54.438041 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-891daf18-b35e-4a90-9f67-f5899bc2fccc tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:54.438832 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-891daf18-b35e-4a90-9f67-f5899bc2fccc tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:54.439261 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-891daf18-b35e-4a90-9f67-f5899bc2fccc tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:54.612093 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-891daf18-b35e-4a90-9f67-f5899bc2fccc tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:54.620268 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-891daf18-b35e-4a90-9f67-f5899bc2fccc tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.195494 Jul 20 15:32:54.620966 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 89/172] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:54 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:32:55.642919 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-ca925a31-a8e2-4514-aa44-f148fb402bc6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:55.653699 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-ca925a31-a8e2-4514-aa44-f148fb402bc6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:55.653699 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ca925a31-a8e2-4514-aa44-f148fb402bc6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:55.654060 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ca925a31-a8e2-4514-aa44-f148fb402bc6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:55.655659 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ca925a31-a8e2-4514-aa44-f148fb402bc6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:55.656478 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ca925a31-a8e2-4514-aa44-f148fb402bc6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:55.856198 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-ca925a31-a8e2-4514-aa44-f148fb402bc6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:55.858996 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-ca925a31-a8e2-4514-aa44-f148fb402bc6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.220918 Jul 20 15:32:55.859614 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 84/173] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:55 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:56.877127 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-a981794e-4489-4e4a-b200-75f3f09fca79 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:56.877946 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-a981794e-4489-4e4a-b200-75f3f09fca79 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:56.885001 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a981794e-4489-4e4a-b200-75f3f09fca79 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:56.885451 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a981794e-4489-4e4a-b200-75f3f09fca79 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:56.886319 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a981794e-4489-4e4a-b200-75f3f09fca79 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:56.886751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a981794e-4489-4e4a-b200-75f3f09fca79 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:56.890967 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:32:57.067961 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-a981794e-4489-4e4a-b200-75f3f09fca79 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:57.076547 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-a981794e-4489-4e4a-b200-75f3f09fca79 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.203522 Jul 20 15:32:57.077480 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 90/174] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:56 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:58.096373 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-c4c49efa-c4eb-407a-91f2-9bdd612eea98 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:58.097700 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-c4c49efa-c4eb-407a-91f2-9bdd612eea98 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:58.107141 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c4c49efa-c4eb-407a-91f2-9bdd612eea98 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:58.107591 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c4c49efa-c4eb-407a-91f2-9bdd612eea98 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:58.108393 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c4c49efa-c4eb-407a-91f2-9bdd612eea98 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:58.108822 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c4c49efa-c4eb-407a-91f2-9bdd612eea98 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:58.324551 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-c4c49efa-c4eb-407a-91f2-9bdd612eea98 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:58.343468 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-c4c49efa-c4eb-407a-91f2-9bdd612eea98 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.245696 Jul 20 15:32:58.343468 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 85/175] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:58 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:32:59.361600 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-19a1ad7f-2e72-4eec-a133-8e3b592e4c32 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:32:59.362359 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-19a1ad7f-2e72-4eec-a133-8e3b592e4c32 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:32:59.370623 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-19a1ad7f-2e72-4eec-a133-8e3b592e4c32 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:59.371075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-19a1ad7f-2e72-4eec-a133-8e3b592e4c32 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:59.372002 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-19a1ad7f-2e72-4eec-a133-8e3b592e4c32 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:32:59.372634 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-19a1ad7f-2e72-4eec-a133-8e3b592e4c32 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:32:59.559576 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-19a1ad7f-2e72-4eec-a133-8e3b592e4c32 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:32:59.569784 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-19a1ad7f-2e72-4eec-a133-8e3b592e4c32 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.212897 Jul 20 15:32:59.570799 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 91/176] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:32:59 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:00.595676 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-71ab08ed-f03a-4687-89d0-1a26ec1ebd8a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:00.596920 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-71ab08ed-f03a-4687-89d0-1a26ec1ebd8a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:00.604144 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-71ab08ed-f03a-4687-89d0-1a26ec1ebd8a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:00.604596 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-71ab08ed-f03a-4687-89d0-1a26ec1ebd8a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:00.605389 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-71ab08ed-f03a-4687-89d0-1a26ec1ebd8a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:00.605823 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-71ab08ed-f03a-4687-89d0-1a26ec1ebd8a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:00.784790 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-71ab08ed-f03a-4687-89d0-1a26ec1ebd8a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:00.793275 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-71ab08ed-f03a-4687-89d0-1a26ec1ebd8a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.201572 Jul 20 15:33:00.793863 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 86/177] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:00 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:33:01.525254 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-a582e833-2d64-4bed-b7ab-9fa3cfba9797 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:01.525853 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-a582e833-2d64-4bed-b7ab-9fa3cfba9797 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:01.533313 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a582e833-2d64-4bed-b7ab-9fa3cfba9797 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:01.533764 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a582e833-2d64-4bed-b7ab-9fa3cfba9797 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:01.537024 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a582e833-2d64-4bed-b7ab-9fa3cfba9797 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:01.537024 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a582e833-2d64-4bed-b7ab-9fa3cfba9797 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:01.564690 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-a582e833-2d64-4bed-b7ab-9fa3cfba9797 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Going to try to terminate instance {{(pid=124711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 15:33:01.812879 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-48de0a13-5611-4faa-ae93-f3ff3d211c9a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:01.813635 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-48de0a13-5611-4faa-ae93-f3ff3d211c9a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:01.820000 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-48de0a13-5611-4faa-ae93-f3ff3d211c9a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:01.820443 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-48de0a13-5611-4faa-ae93-f3ff3d211c9a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:01.821194 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-48de0a13-5611-4faa-ae93-f3ff3d211c9a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:01.821626 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-48de0a13-5611-4faa-ae93-f3ff3d211c9a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:01.993502 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-a582e833-2d64-4bed-b7ab-9fa3cfba9797 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 204 len: 0 microversion: 2.1 time: 0.472197 Jul 20 15:33:01.995233 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 92/178] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:33:01 2022] DELETE /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 15:33:02.000512 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-48de0a13-5611-4faa-ae93-f3ff3d211c9a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:02.004495 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-89d7293e-6485-4f2a-b329-cfdd1564271b tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:02.005200 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-89d7293e-6485-4f2a-b329-cfdd1564271b tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:02.010057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-48de0a13-5611-4faa-ae93-f3ff3d211c9a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.201149 Jul 20 15:33:02.012025 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-89d7293e-6485-4f2a-b329-cfdd1564271b tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:02.012745 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-89d7293e-6485-4f2a-b329-cfdd1564271b tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:02.013466 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-89d7293e-6485-4f2a-b329-cfdd1564271b tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:02.014068 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-89d7293e-6485-4f2a-b329-cfdd1564271b tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:02.015106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 87/179] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:01 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:33:02.185187 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-89d7293e-6485-4f2a-b329-cfdd1564271b tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:02.193210 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-89d7293e-6485-4f2a-b329-cfdd1564271b tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1553 microversion: 2.1 time: 0.193562 Jul 20 15:33:02.193777 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 93/180] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:01 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1553 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:03.027660 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-319927c5-2abd-4d9b-b85e-f2cad08c9113 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:03.028263 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-319927c5-2abd-4d9b-b85e-f2cad08c9113 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:03.035630 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-319927c5-2abd-4d9b-b85e-f2cad08c9113 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:03.036075 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-319927c5-2abd-4d9b-b85e-f2cad08c9113 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:03.036841 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-319927c5-2abd-4d9b-b85e-f2cad08c9113 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:03.037291 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-319927c5-2abd-4d9b-b85e-f2cad08c9113 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:03.196200 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-319927c5-2abd-4d9b-b85e-f2cad08c9113 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:03.203743 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-319927c5-2abd-4d9b-b85e-f2cad08c9113 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.180270 Jul 20 15:33:03.204315 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 88/181] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:03 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:33:03.210600 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-9810d939-e90d-4c27-9557-b20179c486fd tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:03.211323 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-9810d939-e90d-4c27-9557-b20179c486fd tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:03.217972 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9810d939-e90d-4c27-9557-b20179c486fd tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:03.223426 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9810d939-e90d-4c27-9557-b20179c486fd tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:03.223426 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9810d939-e90d-4c27-9557-b20179c486fd tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:03.223426 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9810d939-e90d-4c27-9557-b20179c486fd tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:03.367733 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-9810d939-e90d-4c27-9557-b20179c486fd tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:03.377932 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-9810d939-e90d-4c27-9557-b20179c486fd tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1553 microversion: 2.1 time: 0.171057 Jul 20 15:33:03.378753 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 94/182] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:03 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1553 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:04.220810 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-04111a67-46f5-4bdc-91f3-e45854905bb1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:04.221449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-04111a67-46f5-4bdc-91f3-e45854905bb1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:04.228137 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-04111a67-46f5-4bdc-91f3-e45854905bb1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:04.228911 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-04111a67-46f5-4bdc-91f3-e45854905bb1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:04.229657 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-04111a67-46f5-4bdc-91f3-e45854905bb1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:04.230100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-04111a67-46f5-4bdc-91f3-e45854905bb1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:04.404715 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-1733fa70-6e89-4db2-bde3-51c401e80b9d tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:04.410137 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-1733fa70-6e89-4db2-bde3-51c401e80b9d tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:04.424205 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1733fa70-6e89-4db2-bde3-51c401e80b9d tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:04.424757 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1733fa70-6e89-4db2-bde3-51c401e80b9d tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:04.425572 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1733fa70-6e89-4db2-bde3-51c401e80b9d tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:04.431151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1733fa70-6e89-4db2-bde3-51c401e80b9d tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:04.475474 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-04111a67-46f5-4bdc-91f3-e45854905bb1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:04.485328 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-04111a67-46f5-4bdc-91f3-e45854905bb1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.268278 Jul 20 15:33:04.488828 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 89/183] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:04 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:33:04.686651 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-1733fa70-6e89-4db2-bde3-51c401e80b9d tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:04.697162 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-1733fa70-6e89-4db2-bde3-51c401e80b9d tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1553 microversion: 2.1 time: 0.303897 Jul 20 15:33:04.697851 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 95/184] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:04 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1553 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:05.245433 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-b54ed7b1-7091-4294-bea9-d9b27292ebbe req-e9e9d684-3438-4b57-ae77-0933a4da7466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4629da0b-5da0-4ba3-bb8a-e076cfcbf14d", "name": "network-vif-deleted", "tag": "dcafe070-5aa9-45b4-9985-1e779fe02e07"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:33:05.254908 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-b54ed7b1-7091-4294-bea9-d9b27292ebbe req-e9e9d684-3438-4b57-ae77-0933a4da7466 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:05.255338 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-b54ed7b1-7091-4294-bea9-d9b27292ebbe req-e9e9d684-3438-4b57-ae77-0933a4da7466 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:05.273118 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-b54ed7b1-7091-4294-bea9-d9b27292ebbe req-e9e9d684-3438-4b57-ae77-0933a4da7466 service nova] Creating event network-vif-deleted:dcafe070-5aa9-45b4-9985-1e779fe02e07 for instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d on hv-cinder-81914 Jul 20 15:33:05.280583 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-b54ed7b1-7091-4294-bea9-d9b27292ebbe req-e9e9d684-3438-4b57-ae77-0933a4da7466 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038834 Jul 20 15:33:05.285648 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 90/185] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:33:05.506475 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-605a0b5e-dba8-4740-b06d-b5f9c0fafcf7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:05.507544 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-605a0b5e-dba8-4740-b06d-b5f9c0fafcf7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:05.515785 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-605a0b5e-dba8-4740-b06d-b5f9c0fafcf7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:05.516232 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-605a0b5e-dba8-4740-b06d-b5f9c0fafcf7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:05.517010 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-605a0b5e-dba8-4740-b06d-b5f9c0fafcf7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:05.517518 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-605a0b5e-dba8-4740-b06d-b5f9c0fafcf7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:05.669659 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-605a0b5e-dba8-4740-b06d-b5f9c0fafcf7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:05.677500 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-605a0b5e-dba8-4740-b06d-b5f9c0fafcf7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.175903 Jul 20 15:33:05.678156 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 96/186] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:05 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:05.718946 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-5943c6dc-d985-4c4b-b7e7-4f596c7bbfb3 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:05.719735 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-5943c6dc-d985-4c4b-b7e7-4f596c7bbfb3 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:05.727180 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5943c6dc-d985-4c4b-b7e7-4f596c7bbfb3 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:05.727686 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5943c6dc-d985-4c4b-b7e7-4f596c7bbfb3 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:05.728934 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5943c6dc-d985-4c4b-b7e7-4f596c7bbfb3 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:05.729958 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5943c6dc-d985-4c4b-b7e7-4f596c7bbfb3 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:05.797040 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-5943c6dc-d985-4c4b-b7e7-4f596c7bbfb3 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:05.806513 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-5943c6dc-d985-4c4b-b7e7-4f596c7bbfb3 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1346 microversion: 2.1 time: 0.095434 Jul 20 15:33:05.807095 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 91/187] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:05 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:06.696348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-74b54fb2-a801-43e8-b6b3-ad3d98540dce tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:06.697977 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-74b54fb2-a801-43e8-b6b3-ad3d98540dce tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:06.703869 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-74b54fb2-a801-43e8-b6b3-ad3d98540dce tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:06.704320 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-74b54fb2-a801-43e8-b6b3-ad3d98540dce tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:06.705088 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-74b54fb2-a801-43e8-b6b3-ad3d98540dce tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:06.705520 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-74b54fb2-a801-43e8-b6b3-ad3d98540dce tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:06.827283 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-edf3831a-2337-48ab-ac5d-aa6a9d25dee8 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:06.827893 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-edf3831a-2337-48ab-ac5d-aa6a9d25dee8 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:06.834165 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-edf3831a-2337-48ab-ac5d-aa6a9d25dee8 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:06.834636 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-edf3831a-2337-48ab-ac5d-aa6a9d25dee8 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:06.835535 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-edf3831a-2337-48ab-ac5d-aa6a9d25dee8 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:06.835970 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-edf3831a-2337-48ab-ac5d-aa6a9d25dee8 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:06.868833 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-edf3831a-2337-48ab-ac5d-aa6a9d25dee8 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:06.869264 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-edf3831a-2337-48ab-ac5d-aa6a9d25dee8 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:06.869732 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.objects.instance [None req-edf3831a-2337-48ab-ac5d-aa6a9d25dee8 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lazy-loading 'fault' on Instance uuid 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d {{(pid=124712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:33:06.875679 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-74b54fb2-a801-43e8-b6b3-ad3d98540dce tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:06.883332 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-74b54fb2-a801-43e8-b6b3-ad3d98540dce tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.190972 Jul 20 15:33:06.888194 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 97/188] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:06 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:33:06.922717 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-edf3831a-2337-48ab-ac5d-aa6a9d25dee8 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ce3bfba3724b07a657774662b8d6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80caade751834762862c102c208a34e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:06.929077 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-edf3831a-2337-48ab-ac5d-aa6a9d25dee8 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 200 len: 1351 microversion: 2.1 time: 0.106005 Jul 20 15:33:06.929561 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 92/189] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:06 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 1351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:07.901704 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-0334d3dd-a039-4062-b755-a10ca9e722f9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:07.902337 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-0334d3dd-a039-4062-b755-a10ca9e722f9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:07.908801 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0334d3dd-a039-4062-b755-a10ca9e722f9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:07.909244 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0334d3dd-a039-4062-b755-a10ca9e722f9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:07.910030 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0334d3dd-a039-4062-b755-a10ca9e722f9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:07.910504 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0334d3dd-a039-4062-b755-a10ca9e722f9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:07.953634 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-0be442fd-de2a-411c-83ad-89bdedcaa7cd tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:07.954989 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-0be442fd-de2a-411c-83ad-89bdedcaa7cd tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:07.962435 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0be442fd-de2a-411c-83ad-89bdedcaa7cd tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:07.962959 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0be442fd-de2a-411c-83ad-89bdedcaa7cd tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:07.964980 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0be442fd-de2a-411c-83ad-89bdedcaa7cd tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:07.964980 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0be442fd-de2a-411c-83ad-89bdedcaa7cd tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:07.984013 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-0be442fd-de2a-411c-83ad-89bdedcaa7cd tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] HTTP exception thrown: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. Jul 20 15:33:07.991177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-0be442fd-de2a-411c-83ad-89bdedcaa7cd tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Request method failure captured: Jul 20 15:33:07.991177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d HTTP/1.1 Jul 20 15:33:07.991177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:33:07.991177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:33:07.991177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:33:07.991177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:33:07.991177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:33:07.991177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:33:07.991177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:33:07.991177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:33:07.991177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2B_ub-A_3xuQXHTD-opwqBYM61kqPawkjuXUS7XWHe1XlamX1z-I2IxX1OOTVlyqn5E2I3yLwzafdLl47Nn3YUjoQ0trj5U4mb4peDZsPkg00dWl7fqhAVI0KVVl6y0Ap8Pd0AMGhUf7XGipoOEWetKQHOBfkrd8Wfkd0bsL9WpvPuc Jul 20 15:33:07.991177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:33:07.991177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:33:07.991177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:33:07.991177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:33:07.991177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:33:07.991177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:33:07.991177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 80caade751834762862c102c208a34e1 Jul 20 15:33:07.991177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-DeleteServersTestJSON-1946843890 Jul 20 15:33:07.991177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:33:07.991177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:33:07.999776 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/80caade751834762862c102c208a34e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/80caade751834762862c102c208a34e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_80caade751834762862c102c208a34e1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/80caade751834762862c102c208a34e1"}]}] Jul 20 15:33:07.999776 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-DeleteServersTestJSON-1946843890 Jul 20 15:33:07.999776 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 80caade751834762862c102c208a34e1 Jul 20 15:33:07.999776 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-DeleteServersTestJSON-1946843890 Jul 20 15:33:07.999776 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-DeleteServersTestJSON-1946843890-project Jul 20 15:33:07.999776 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:33:07.999776 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:33:07.999776 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: 48ce3bfba3724b07a657774662b8d6f3 Jul 20 15:33:07.999776 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-DeleteServersTestJSON-1946843890-project Jul 20 15:33:07.999776 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:33:07.999776 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. Jul 20 15:33:07.999776 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': '4629da0b-5da0-4ba3-bb8a-e076cfcbf14d'} Jul 20 15:33:08.000575 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:33:08.000575 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:33:08.000575 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:33:08.000575 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:33:08.000575 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:33:08.000575 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:33:08.000575 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:33:08.000575 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:33:08.000575 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:33:08.000575 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:33:08.000575 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. Jul 20 15:33:08.000575 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:33:08.000575 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:33:08.000575 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:33:08.000575 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:33:08.000575 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:33:08.000575 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:33:08.000575 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:33:08.000575 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:33:08.000575 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:33:08.001805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:33:08.001805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:33:08.001805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:33:08.001805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:33:08.001805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:33:08.001805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:33:08.001805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:33:08.001805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. Jul 20 15:33:08.001805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:33:08.001805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:33:08.001805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:33:08.001805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:33:08.001805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:33:08.001805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:33:08.001805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:33:08.001805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:33:08.001805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. Jul 20 15:33:08.001805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:33:08.004656 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-0be442fd-de2a-411c-83ad-89bdedcaa7cd tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Returning 404 to user: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:33:08.004656 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-0be442fd-de2a-411c-83ad-89bdedcaa7cd tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 404 len: 111 microversion: 2.1 time: 0.049902 Jul 20 15:33:08.004656 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 93/190] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:07 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:33:08.106944 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-0334d3dd-a039-4062-b755-a10ca9e722f9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:08.121433 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-0334d3dd-a039-4062-b755-a10ca9e722f9 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.223889 Jul 20 15:33:08.122640 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 98/191] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:07 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:08.131166 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-f28615d8-1f2a-4fe7-b2fc-b0bf7583bd28 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:08.132156 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-f28615d8-1f2a-4fe7-b2fc-b0bf7583bd28 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:08.146762 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f28615d8-1f2a-4fe7-b2fc-b0bf7583bd28 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:08.146762 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f28615d8-1f2a-4fe7-b2fc-b0bf7583bd28 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:08.146762 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f28615d8-1f2a-4fe7-b2fc-b0bf7583bd28 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:08.146762 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f28615d8-1f2a-4fe7-b2fc-b0bf7583bd28 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:08.155349 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-f28615d8-1f2a-4fe7-b2fc-b0bf7583bd28 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] HTTP exception thrown: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. Jul 20 15:33:08.157041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-f28615d8-1f2a-4fe7-b2fc-b0bf7583bd28 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Request method failure captured: Jul 20 15:33:08.157041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d/os-volume_attachments HTTP/1.1 Jul 20 15:33:08.157041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:33:08.157041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:33:08.157041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:33:08.157041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:33:08.157041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:33:08.157041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:33:08.157041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:33:08.157041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:33:08.157041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2B_ub-A_3xuQXHTD-opwqBYM61kqPawkjuXUS7XWHe1XlamX1z-I2IxX1OOTVlyqn5E2I3yLwzafdLl47Nn3YUjoQ0trj5U4mb4peDZsPkg00dWl7fqhAVI0KVVl6y0Ap8Pd0AMGhUf7XGipoOEWetKQHOBfkrd8Wfkd0bsL9WpvPuc Jul 20 15:33:08.157041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:33:08.157041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:33:08.157041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:33:08.157041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:33:08.157041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:33:08.157041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:33:08.157041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 80caade751834762862c102c208a34e1 Jul 20 15:33:08.157041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-DeleteServersTestJSON-1946843890 Jul 20 15:33:08.157041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:33:08.157041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:33:08.163918 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/80caade751834762862c102c208a34e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/80caade751834762862c102c208a34e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_80caade751834762862c102c208a34e1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/80caade751834762862c102c208a34e1"}]}] Jul 20 15:33:08.163918 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-DeleteServersTestJSON-1946843890 Jul 20 15:33:08.163918 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 80caade751834762862c102c208a34e1 Jul 20 15:33:08.163918 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-DeleteServersTestJSON-1946843890 Jul 20 15:33:08.163918 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-DeleteServersTestJSON-1946843890-project Jul 20 15:33:08.163918 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:33:08.163918 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:33:08.163918 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: 48ce3bfba3724b07a657774662b8d6f3 Jul 20 15:33:08.163918 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-DeleteServersTestJSON-1946843890-project Jul 20 15:33:08.163918 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:33:08.163918 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. Jul 20 15:33:08.163918 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'server_id': '4629da0b-5da0-4ba3-bb8a-e076cfcbf14d'} Jul 20 15:33:08.164909 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:33:08.164909 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:33:08.164909 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:33:08.164909 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:33:08.164909 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:33:08.164909 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:33:08.164909 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:33:08.164909 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:33:08.164909 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:33:08.164909 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:33:08.164909 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. Jul 20 15:33:08.164909 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:33:08.164909 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:33:08.164909 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:33:08.164909 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:33:08.164909 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:33:08.164909 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:33:08.164909 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:33:08.164909 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:33:08.164909 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:33:08.170543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:33:08.170543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 15:33:08.170543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 15:33:08.170543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 15:33:08.170543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 15:33:08.170543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 20 15:33:08.170543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 20 15:33:08.170543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:33:08.170543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:33:08.170543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. Jul 20 15:33:08.170543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:33:08.170543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:33:08.170543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:33:08.170543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:33:08.170543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:33:08.170543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:33:08.170543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:33:08.170543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:33:08.170543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. Jul 20 15:33:08.170543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:33:08.173120 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-f28615d8-1f2a-4fe7-b2fc-b0bf7583bd28 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Returning 404 to user: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:33:08.173120 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-f28615d8-1f2a-4fe7-b2fc-b0bf7583bd28 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031819 Jul 20 15:33:08.173120 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 94/192] 10.222.0.78 () {58 vars in 1301 bytes} [Wed Jul 20 15:33:08 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:33:09.139319 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-07940976-bf78-4781-a5c1-295df6e55c27 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:09.140181 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-07940976-bf78-4781-a5c1-295df6e55c27 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:09.149015 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-07940976-bf78-4781-a5c1-295df6e55c27 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:09.152190 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-07940976-bf78-4781-a5c1-295df6e55c27 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:09.153485 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-07940976-bf78-4781-a5c1-295df6e55c27 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:09.153940 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-07940976-bf78-4781-a5c1-295df6e55c27 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:09.296888 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-07940976-bf78-4781-a5c1-295df6e55c27 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:09.304396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-07940976-bf78-4781-a5c1-295df6e55c27 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.168945 Jul 20 15:33:09.304957 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 99/193] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:09 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:10.320879 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d81b0fcc-28c2-49c1-ba6a-c3f966810cbc tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:10.321612 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d81b0fcc-28c2-49c1-ba6a-c3f966810cbc tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:10.328009 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d81b0fcc-28c2-49c1-ba6a-c3f966810cbc tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:10.328665 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d81b0fcc-28c2-49c1-ba6a-c3f966810cbc tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:10.329442 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d81b0fcc-28c2-49c1-ba6a-c3f966810cbc tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:10.329881 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d81b0fcc-28c2-49c1-ba6a-c3f966810cbc tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:10.469604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d81b0fcc-28c2-49c1-ba6a-c3f966810cbc tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:10.477114 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-d81b0fcc-28c2-49c1-ba6a-c3f966810cbc tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.160067 Jul 20 15:33:10.477727 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 95/194] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:10 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:11.494799 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5f7ade08-01e9-449a-af1c-a1c44b320c51 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:11.500932 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5f7ade08-01e9-449a-af1c-a1c44b320c51 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:11.502168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5f7ade08-01e9-449a-af1c-a1c44b320c51 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:11.502660 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5f7ade08-01e9-449a-af1c-a1c44b320c51 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:11.503459 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5f7ade08-01e9-449a-af1c-a1c44b320c51 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:11.503890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5f7ade08-01e9-449a-af1c-a1c44b320c51 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:11.679786 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5f7ade08-01e9-449a-af1c-a1c44b320c51 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:11.689702 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5f7ade08-01e9-449a-af1c-a1c44b320c51 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.198765 Jul 20 15:33:11.690587 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 100/195] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:11 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:12.711244 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e600c373-717f-489e-8e89-1e8f986e203e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:12.711860 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e600c373-717f-489e-8e89-1e8f986e203e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:12.718449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e600c373-717f-489e-8e89-1e8f986e203e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:12.718898 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e600c373-717f-489e-8e89-1e8f986e203e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:12.719672 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e600c373-717f-489e-8e89-1e8f986e203e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:12.720105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e600c373-717f-489e-8e89-1e8f986e203e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:12.840838 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-f74e8842-8d89-4666-8e7f-1974f75d939b tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:12.842965 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-f74e8842-8d89-4666-8e7f-1974f75d939b tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:12.857484 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f74e8842-8d89-4666-8e7f-1974f75d939b tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:12.858865 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f74e8842-8d89-4666-8e7f-1974f75d939b tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:12.860255 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f74e8842-8d89-4666-8e7f-1974f75d939b tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:12.861225 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f74e8842-8d89-4666-8e7f-1974f75d939b tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:12.889065 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-e600c373-717f-489e-8e89-1e8f986e203e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:12.889402 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-f74e8842-8d89-4666-8e7f-1974f75d939b tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] HTTP exception thrown: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. Jul 20 15:33:12.894202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-f74e8842-8d89-4666-8e7f-1974f75d939b tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Request method failure captured: Jul 20 15:33:12.894202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: DELETE /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d HTTP/1.1 Jul 20 15:33:12.894202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:33:12.894202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:33:12.894202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:33:12.894202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:33:12.894202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:33:12.894202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:33:12.894202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:33:12.894202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:33:12.894202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2B_ub-A_3xuQXHTD-opwqBYM61kqPawkjuXUS7XWHe1XlamX1z-I2IxX1OOTVlyqn5E2I3yLwzafdLl47Nn3YUjoQ0trj5U4mb4peDZsPkg00dWl7fqhAVI0KVVl6y0Ap8Pd0AMGhUf7XGipoOEWetKQHOBfkrd8Wfkd0bsL9WpvPuc Jul 20 15:33:12.894202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:33:12.894202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:33:12.894202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:33:12.894202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:33:12.894202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:33:12.894202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:33:12.894202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: 80caade751834762862c102c208a34e1 Jul 20 15:33:12.894202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-DeleteServersTestJSON-1946843890 Jul 20 15:33:12.894202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:33:12.894202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:33:12.895800 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/80caade751834762862c102c208a34e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/80caade751834762862c102c208a34e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_80caade751834762862c102c208a34e1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/80caade751834762862c102c208a34e1"}]}] Jul 20 15:33:12.895800 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-DeleteServersTestJSON-1946843890 Jul 20 15:33:12.895800 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: 80caade751834762862c102c208a34e1 Jul 20 15:33:12.895800 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-DeleteServersTestJSON-1946843890 Jul 20 15:33:12.895800 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-DeleteServersTestJSON-1946843890-project Jul 20 15:33:12.895800 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:33:12.895800 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:33:12.895800 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: 48ce3bfba3724b07a657774662b8d6f3 Jul 20 15:33:12.895800 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-DeleteServersTestJSON-1946843890-project Jul 20 15:33:12.895800 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: > Jul 20 15:33:12.895800 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. Jul 20 15:33:12.895800 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': '4629da0b-5da0-4ba3-bb8a-e076cfcbf14d'} Jul 20 15:33:12.896807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:33:12.896807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:33:12.896807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:33:12.896807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:33:12.896807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:33:12.896807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:33:12.896807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:33:12.896807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:33:12.896807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:33:12.896807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:33:12.896807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. Jul 20 15:33:12.896807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:33:12.896807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:33:12.896807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:33:12.896807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:33:12.896807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:33:12.896807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:33:12.896807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:33:12.896807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:33:12.896807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:33:12.898348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:33:12.898348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 15:33:12.898348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 15:33:12.898348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 15:33:12.898348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 15:33:12.898348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:33:12.898348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:33:12.898348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:33:12.898348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:33:12.898348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. Jul 20 15:33:12.898348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:33:12.898348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:33:12.898348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:33:12.898348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:33:12.898348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:33:12.898348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:33:12.898348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:33:12.898348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:33:12.898348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. Jul 20 15:33:12.898348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:33:12.899772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-f74e8842-8d89-4666-8e7f-1974f75d939b tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Returning 404 to user: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:33:12.899772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-f74e8842-8d89-4666-8e7f-1974f75d939b tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 404 len: 111 microversion: 2.1 time: 0.065961 Jul 20 15:33:12.900253 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 101/196] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:33:12 2022] DELETE /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:33:12.906006 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-632df68a-babb-428a-ae40-e03f0bd04992 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:12.906665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-632df68a-babb-428a-ae40-e03f0bd04992 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] [instance: 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:12.913179 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-e600c373-717f-489e-8e89-1e8f986e203e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.206328 Jul 20 15:33:12.913453 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-632df68a-babb-428a-ae40-e03f0bd04992 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:12.914003 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 96/197] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:12 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:12.918494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-632df68a-babb-428a-ae40-e03f0bd04992 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:12.918494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-632df68a-babb-428a-ae40-e03f0bd04992 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:12.918494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-632df68a-babb-428a-ae40-e03f0bd04992 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:12.939907 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-632df68a-babb-428a-ae40-e03f0bd04992 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] HTTP exception thrown: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. Jul 20 15:33:12.941516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-632df68a-babb-428a-ae40-e03f0bd04992 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Request method failure captured: Jul 20 15:33:12.941516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d HTTP/1.1 Jul 20 15:33:12.941516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:33:12.941516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:33:12.941516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:33:12.941516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:33:12.941516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:33:12.941516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:33:12.941516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:33:12.941516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:33:12.941516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2B_ub-A_3xuQXHTD-opwqBYM61kqPawkjuXUS7XWHe1XlamX1z-I2IxX1OOTVlyqn5E2I3yLwzafdLl47Nn3YUjoQ0trj5U4mb4peDZsPkg00dWl7fqhAVI0KVVl6y0Ap8Pd0AMGhUf7XGipoOEWetKQHOBfkrd8Wfkd0bsL9WpvPuc Jul 20 15:33:12.941516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:33:12.941516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:33:12.941516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:33:12.941516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:33:12.941516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:33:12.941516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:33:12.941516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: 80caade751834762862c102c208a34e1 Jul 20 15:33:12.941516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-DeleteServersTestJSON-1946843890 Jul 20 15:33:12.941516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:33:12.941516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:33:12.942954 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/80caade751834762862c102c208a34e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/80caade751834762862c102c208a34e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_80caade751834762862c102c208a34e1", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/80caade751834762862c102c208a34e1"}]}] Jul 20 15:33:12.942954 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-DeleteServersTestJSON-1946843890 Jul 20 15:33:12.942954 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: 80caade751834762862c102c208a34e1 Jul 20 15:33:12.942954 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-DeleteServersTestJSON-1946843890 Jul 20 15:33:12.942954 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-DeleteServersTestJSON-1946843890-project Jul 20 15:33:12.942954 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:33:12.942954 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:33:12.942954 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: 48ce3bfba3724b07a657774662b8d6f3 Jul 20 15:33:12.942954 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-DeleteServersTestJSON-1946843890-project Jul 20 15:33:12.942954 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: > Jul 20 15:33:12.942954 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. Jul 20 15:33:12.942954 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': '4629da0b-5da0-4ba3-bb8a-e076cfcbf14d'} Jul 20 15:33:12.943847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:33:12.943847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:33:12.943847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:33:12.943847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:33:12.943847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:33:12.943847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:33:12.943847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:33:12.943847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:33:12.943847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:33:12.943847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:33:12.943847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. Jul 20 15:33:12.943847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:33:12.943847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:33:12.943847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:33:12.943847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:33:12.943847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:33:12.943847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:33:12.943847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:33:12.943847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:33:12.943847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:33:12.945075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:33:12.945075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:33:12.945075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:33:12.945075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:33:12.945075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:33:12.945075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:33:12.945075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:33:12.945075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. Jul 20 15:33:12.945075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:33:12.945075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:33:12.945075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:33:12.945075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:33:12.945075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:33:12.945075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:33:12.945075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:33:12.945075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:33:12.945075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. Jul 20 15:33:12.945075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:33:12.946247 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-632df68a-babb-428a-ae40-e03f0bd04992 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] Returning 404 to user: Instance 4629da0b-5da0-4ba3-bb8a-e076cfcbf14d could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:33:12.946247 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-632df68a-babb-428a-ae40-e03f0bd04992 tempest-DeleteServersTestJSON-1946843890 tempest-DeleteServersTestJSON-1946843890-project] 10.222.0.78 "GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d" status: 404 len: 111 microversion: 2.1 time: 0.041798 Jul 20 15:33:12.946247 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 102/198] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:12 2022] GET /compute/v2.1/servers/4629da0b-5da0-4ba3-bb8a-e076cfcbf14d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:33:13.934785 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-170415a8-9a61-4a29-8926-5ccf8d0e7616 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:13.935805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-170415a8-9a61-4a29-8926-5ccf8d0e7616 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:13.943861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-170415a8-9a61-4a29-8926-5ccf8d0e7616 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:13.944342 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-170415a8-9a61-4a29-8926-5ccf8d0e7616 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:13.945152 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-170415a8-9a61-4a29-8926-5ccf8d0e7616 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:13.945598 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-170415a8-9a61-4a29-8926-5ccf8d0e7616 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:14.166082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-170415a8-9a61-4a29-8926-5ccf8d0e7616 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:14.178333 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-170415a8-9a61-4a29-8926-5ccf8d0e7616 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.247249 Jul 20 15:33:14.179176 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 97/199] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:13 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:33:15.200937 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-2df98c85-7f89-475a-a8f4-1840dd06d9c4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:15.203196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-2df98c85-7f89-475a-a8f4-1840dd06d9c4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:15.207850 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:15.223649 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2df98c85-7f89-475a-a8f4-1840dd06d9c4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:15.224059 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2df98c85-7f89-475a-a8f4-1840dd06d9c4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:15.224848 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2df98c85-7f89-475a-a8f4-1840dd06d9c4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:15.225280 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2df98c85-7f89-475a-a8f4-1840dd06d9c4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:15.420598 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2df98c85-7f89-475a-a8f4-1840dd06d9c4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:15.431915 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-2df98c85-7f89-475a-a8f4-1840dd06d9c4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.235684 Jul 20 15:33:15.432764 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 103/200] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:15 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:16.449833 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-59f1cfa3-3e07-4fbc-8d06-7eaf6a7cb954 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:16.450570 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-59f1cfa3-3e07-4fbc-8d06-7eaf6a7cb954 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:16.458193 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-59f1cfa3-3e07-4fbc-8d06-7eaf6a7cb954 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:16.458755 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-59f1cfa3-3e07-4fbc-8d06-7eaf6a7cb954 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:16.459806 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-59f1cfa3-3e07-4fbc-8d06-7eaf6a7cb954 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:16.460350 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-59f1cfa3-3e07-4fbc-8d06-7eaf6a7cb954 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:16.658722 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-59f1cfa3-3e07-4fbc-8d06-7eaf6a7cb954 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:16.661589 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=100 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:16.676010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-59f1cfa3-3e07-4fbc-8d06-7eaf6a7cb954 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.227263 Jul 20 15:33:16.676010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 98/201] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:16 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:33:17.690563 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-09361284-4466-49ed-9909-2803e3881058 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:17.691179 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-09361284-4466-49ed-9909-2803e3881058 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:17.698129 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-09361284-4466-49ed-9909-2803e3881058 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:17.698621 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-09361284-4466-49ed-9909-2803e3881058 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:17.700103 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-09361284-4466-49ed-9909-2803e3881058 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:17.700103 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-09361284-4466-49ed-9909-2803e3881058 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:18.270027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-09361284-4466-49ed-9909-2803e3881058 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:18.280766 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-09361284-4466-49ed-9909-2803e3881058 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.594039 Jul 20 15:33:18.281342 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 104/202] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:17 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:19.301655 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-cc4489f8-7754-4475-a239-3bcc33660e8f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:19.302366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-cc4489f8-7754-4475-a239-3bcc33660e8f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:19.309445 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cc4489f8-7754-4475-a239-3bcc33660e8f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:19.309895 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cc4489f8-7754-4475-a239-3bcc33660e8f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:19.310741 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cc4489f8-7754-4475-a239-3bcc33660e8f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:19.311176 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cc4489f8-7754-4475-a239-3bcc33660e8f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:19.508127 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-cc4489f8-7754-4475-a239-3bcc33660e8f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:19.528188 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-cc4489f8-7754-4475-a239-3bcc33660e8f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.231298 Jul 20 15:33:19.540387 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 99/203] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:19 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:20.545696 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5d734ff9-e9ad-43a6-9481-1f35cce22621 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:20.548678 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5d734ff9-e9ad-43a6-9481-1f35cce22621 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:20.553559 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5d734ff9-e9ad-43a6-9481-1f35cce22621 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:20.554014 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5d734ff9-e9ad-43a6-9481-1f35cce22621 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:20.554924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5d734ff9-e9ad-43a6-9481-1f35cce22621 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:20.555390 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5d734ff9-e9ad-43a6-9481-1f35cce22621 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:20.735102 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5d734ff9-e9ad-43a6-9481-1f35cce22621 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:20.743961 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5d734ff9-e9ad-43a6-9481-1f35cce22621 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.202546 Jul 20 15:33:20.744793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 105/204] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:20 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:21.764569 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-922baae3-4ed6-4310-a02c-f3defcea9344 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:21.765258 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-922baae3-4ed6-4310-a02c-f3defcea9344 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:21.768823 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=46 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:21.775127 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-922baae3-4ed6-4310-a02c-f3defcea9344 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:21.775603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-922baae3-4ed6-4310-a02c-f3defcea9344 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:21.777158 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-922baae3-4ed6-4310-a02c-f3defcea9344 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:21.777735 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-922baae3-4ed6-4310-a02c-f3defcea9344 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:21.955695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-922baae3-4ed6-4310-a02c-f3defcea9344 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:21.966144 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-922baae3-4ed6-4310-a02c-f3defcea9344 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.207573 Jul 20 15:33:21.966943 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 100/205] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:21 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:22.983591 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-4fd141c4-7492-4787-a254-20e986de6f3e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:22.984430 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-4fd141c4-7492-4787-a254-20e986de6f3e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:22.990850 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4fd141c4-7492-4787-a254-20e986de6f3e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:22.991522 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4fd141c4-7492-4787-a254-20e986de6f3e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:22.992278 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4fd141c4-7492-4787-a254-20e986de6f3e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:22.992705 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4fd141c4-7492-4787-a254-20e986de6f3e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:23.024368 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:23.179060 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-4fd141c4-7492-4787-a254-20e986de6f3e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:23.198063 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-4fd141c4-7492-4787-a254-20e986de6f3e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.209399 Jul 20 15:33:23.198063 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 106/206] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:22 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:24.207526 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d3cb67ba-9e8d-4617-90a5-0e3823b82931 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:24.208371 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d3cb67ba-9e8d-4617-90a5-0e3823b82931 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:24.215850 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d3cb67ba-9e8d-4617-90a5-0e3823b82931 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:24.216308 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d3cb67ba-9e8d-4617-90a5-0e3823b82931 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:24.217095 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d3cb67ba-9e8d-4617-90a5-0e3823b82931 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:24.217541 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d3cb67ba-9e8d-4617-90a5-0e3823b82931 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:24.389277 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d3cb67ba-9e8d-4617-90a5-0e3823b82931 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:24.401373 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-d3cb67ba-9e8d-4617-90a5-0e3823b82931 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.198358 Jul 20 15:33:24.401958 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 101/207] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:24 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:25.419769 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-b796ef66-0ebb-473b-8abd-876c1c6bca8a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:25.420424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-b796ef66-0ebb-473b-8abd-876c1c6bca8a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:25.427348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b796ef66-0ebb-473b-8abd-876c1c6bca8a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:25.427797 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b796ef66-0ebb-473b-8abd-876c1c6bca8a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:25.428633 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b796ef66-0ebb-473b-8abd-876c1c6bca8a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:25.429068 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b796ef66-0ebb-473b-8abd-876c1c6bca8a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:25.571672 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-b796ef66-0ebb-473b-8abd-876c1c6bca8a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:25.581270 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-b796ef66-0ebb-473b-8abd-876c1c6bca8a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1520 microversion: 2.1 time: 0.164714 Jul 20 15:33:25.581270 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 107/208] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:25 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:26.596927 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-f0f7b9ca-5441-40b6-9c01-6d23b14d00e2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:26.597552 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-f0f7b9ca-5441-40b6-9c01-6d23b14d00e2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:26.604263 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f0f7b9ca-5441-40b6-9c01-6d23b14d00e2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:26.604721 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f0f7b9ca-5441-40b6-9c01-6d23b14d00e2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:26.605478 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f0f7b9ca-5441-40b6-9c01-6d23b14d00e2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:26.605904 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f0f7b9ca-5441-40b6-9c01-6d23b14d00e2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:26.742462 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-f0f7b9ca-5441-40b6-9c01-6d23b14d00e2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:26.750286 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-f0f7b9ca-5441-40b6-9c01-6d23b14d00e2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1500 microversion: 2.1 time: 0.157253 Jul 20 15:33:26.750856 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 102/209] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:26 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1500 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:26.766521 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-aed4f8b4-a442-448d-a020-56316b815a6d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:26.767259 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-aed4f8b4-a442-448d-a020-56316b815a6d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:26.775447 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-aed4f8b4-a442-448d-a020-56316b815a6d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:26.775843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-aed4f8b4-a442-448d-a020-56316b815a6d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:26.776616 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-aed4f8b4-a442-448d-a020-56316b815a6d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:26.777057 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-aed4f8b4-a442-448d-a020-56316b815a6d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:26.917311 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-aed4f8b4-a442-448d-a020-56316b815a6d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:26.925237 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-aed4f8b4-a442-448d-a020-56316b815a6d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1514 microversion: 2.1 time: 0.162966 Jul 20 15:33:26.925816 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 108/210] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:26 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:31.099300 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b2b6ccb6-8a28-4843-a5f6-1397b8d0b921 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:33:31.100251 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b2b6ccb6-8a28-4843-a5f6-1397b8d0b921 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:31.106485 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b2b6ccb6-8a28-4843-a5f6-1397b8d0b921 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:31.106927 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b2b6ccb6-8a28-4843-a5f6-1397b8d0b921 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:31.107679 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b2b6ccb6-8a28-4843-a5f6-1397b8d0b921 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:31.108107 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b2b6ccb6-8a28-4843-a5f6-1397b8d0b921 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:31.136588 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.objects.instance [None req-b2b6ccb6-8a28-4843-a5f6-1397b8d0b921 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lazy-loading 'flavor' on Instance uuid e0e200ad-ac34-4618-9518-9cc89ec380de {{(pid=124712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:33:31.515372 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b2b6ccb6-8a28-4843-a5f6-1397b8d0b921 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "POST /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de/action" status: 200 len: 32 microversion: 2.1 time: 0.420113 Jul 20 15:33:31.521867 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 103/211] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Jul 20 15:33:31 2022] POST /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de/action => generated 32 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 15:33:31.530086 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-2c65e8e7-fb8f-4884-8e32-eb5630e5db6e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:31.530735 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-2c65e8e7-fb8f-4884-8e32-eb5630e5db6e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:31.538592 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2c65e8e7-fb8f-4884-8e32-eb5630e5db6e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:31.539285 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2c65e8e7-fb8f-4884-8e32-eb5630e5db6e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:31.540106 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2c65e8e7-fb8f-4884-8e32-eb5630e5db6e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:31.540909 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2c65e8e7-fb8f-4884-8e32-eb5630e5db6e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:31.862500 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2c65e8e7-fb8f-4884-8e32-eb5630e5db6e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:31.875541 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-2c65e8e7-fb8f-4884-8e32-eb5630e5db6e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1520 microversion: 2.1 time: 0.349457 Jul 20 15:33:31.878315 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 109/212] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:31 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1520 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:32.898175 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-6e51af81-9c3a-4df1-ab0b-32680ffb71be tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:32.898896 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-6e51af81-9c3a-4df1-ab0b-32680ffb71be tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:32.906646 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6e51af81-9c3a-4df1-ab0b-32680ffb71be tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:32.907096 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6e51af81-9c3a-4df1-ab0b-32680ffb71be tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:32.907872 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6e51af81-9c3a-4df1-ab0b-32680ffb71be tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:32.908306 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6e51af81-9c3a-4df1-ab0b-32680ffb71be tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:33.050130 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-6e51af81-9c3a-4df1-ab0b-32680ffb71be tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:33.058410 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-6e51af81-9c3a-4df1-ab0b-32680ffb71be tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1520 microversion: 2.1 time: 0.166595 Jul 20 15:33:33.058995 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 104/213] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:32 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:34.077021 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-6f0f246f-db53-40aa-98e6-b1e0d6baeacf tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:34.077645 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-6f0f246f-db53-40aa-98e6-b1e0d6baeacf tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:34.083811 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6f0f246f-db53-40aa-98e6-b1e0d6baeacf tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:34.084259 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6f0f246f-db53-40aa-98e6-b1e0d6baeacf tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:34.085024 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6f0f246f-db53-40aa-98e6-b1e0d6baeacf tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:34.085459 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6f0f246f-db53-40aa-98e6-b1e0d6baeacf tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:34.220144 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-6f0f246f-db53-40aa-98e6-b1e0d6baeacf tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:34.228008 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-6f0f246f-db53-40aa-98e6-b1e0d6baeacf tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1520 microversion: 2.1 time: 0.156330 Jul 20 15:33:34.228565 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 110/214] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:34 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:35.245084 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b2e0322c-6d57-4e6e-b2eb-6337dc532de6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:35.245740 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b2e0322c-6d57-4e6e-b2eb-6337dc532de6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:35.252298 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b2e0322c-6d57-4e6e-b2eb-6337dc532de6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:35.252746 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b2e0322c-6d57-4e6e-b2eb-6337dc532de6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:35.253511 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b2e0322c-6d57-4e6e-b2eb-6337dc532de6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:35.253938 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b2e0322c-6d57-4e6e-b2eb-6337dc532de6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:35.409488 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b2e0322c-6d57-4e6e-b2eb-6337dc532de6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:35.419055 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b2e0322c-6d57-4e6e-b2eb-6337dc532de6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1520 microversion: 2.1 time: 0.177838 Jul 20 15:33:35.419622 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 105/215] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:35 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:36.438812 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-fbf276d0-d441-479b-9f86-b4d3178a696e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:36.439419 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-fbf276d0-d441-479b-9f86-b4d3178a696e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:36.445933 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fbf276d0-d441-479b-9f86-b4d3178a696e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:36.446419 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fbf276d0-d441-479b-9f86-b4d3178a696e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:36.447192 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fbf276d0-d441-479b-9f86-b4d3178a696e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:36.447774 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fbf276d0-d441-479b-9f86-b4d3178a696e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:36.591913 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-fbf276d0-d441-479b-9f86-b4d3178a696e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:36.599630 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-fbf276d0-d441-479b-9f86-b4d3178a696e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1520 microversion: 2.1 time: 0.164556 Jul 20 15:33:36.600197 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 111/216] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:36 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:37.620018 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b20ddc0f-06fe-4439-97e4-624a87637aa6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:37.620018 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b20ddc0f-06fe-4439-97e4-624a87637aa6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:37.626041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b20ddc0f-06fe-4439-97e4-624a87637aa6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:37.626538 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b20ddc0f-06fe-4439-97e4-624a87637aa6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:37.627300 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b20ddc0f-06fe-4439-97e4-624a87637aa6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:37.627904 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b20ddc0f-06fe-4439-97e4-624a87637aa6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:37.763414 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b20ddc0f-06fe-4439-97e4-624a87637aa6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:37.771267 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b20ddc0f-06fe-4439-97e4-624a87637aa6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1520 microversion: 2.1 time: 0.158477 Jul 20 15:33:37.771828 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 106/217] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:37 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:38.788507 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-99f076b0-af90-4d7a-9f85-7e2053c1dce1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:38.789196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-99f076b0-af90-4d7a-9f85-7e2053c1dce1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:38.795840 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-99f076b0-af90-4d7a-9f85-7e2053c1dce1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:38.796314 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-99f076b0-af90-4d7a-9f85-7e2053c1dce1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:38.797081 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-99f076b0-af90-4d7a-9f85-7e2053c1dce1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:38.797509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-99f076b0-af90-4d7a-9f85-7e2053c1dce1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:38.936043 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-99f076b0-af90-4d7a-9f85-7e2053c1dce1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:38.943899 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-99f076b0-af90-4d7a-9f85-7e2053c1dce1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1520 microversion: 2.1 time: 0.159282 Jul 20 15:33:38.944483 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 112/218] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:38 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:39.961380 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-1b2da4b2-6c2b-48c4-9fbc-c692be83416c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:39.961986 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-1b2da4b2-6c2b-48c4-9fbc-c692be83416c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:39.970229 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1b2da4b2-6c2b-48c4-9fbc-c692be83416c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:39.970681 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1b2da4b2-6c2b-48c4-9fbc-c692be83416c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:39.971371 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1b2da4b2-6c2b-48c4-9fbc-c692be83416c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:39.971800 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1b2da4b2-6c2b-48c4-9fbc-c692be83416c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:40.112240 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-1b2da4b2-6c2b-48c4-9fbc-c692be83416c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:40.119911 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-1b2da4b2-6c2b-48c4-9fbc-c692be83416c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1520 microversion: 2.1 time: 0.162763 Jul 20 15:33:40.120680 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 107/219] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:39 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:41.136567 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-722de3fb-fca6-4c44-bbb5-1c83ae95b6f1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:41.137170 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-722de3fb-fca6-4c44-bbb5-1c83ae95b6f1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:41.144515 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-722de3fb-fca6-4c44-bbb5-1c83ae95b6f1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:41.145089 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-722de3fb-fca6-4c44-bbb5-1c83ae95b6f1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:41.145808 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-722de3fb-fca6-4c44-bbb5-1c83ae95b6f1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:41.146240 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-722de3fb-fca6-4c44-bbb5-1c83ae95b6f1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:41.282591 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-722de3fb-fca6-4c44-bbb5-1c83ae95b6f1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:41.289951 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-722de3fb-fca6-4c44-bbb5-1c83ae95b6f1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1520 microversion: 2.1 time: 0.157229 Jul 20 15:33:41.290541 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 113/220] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:41 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:42.306231 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-8b81a013-a2c2-418a-9ef0-608a4de78a0b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:42.306855 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-8b81a013-a2c2-418a-9ef0-608a4de78a0b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:42.313160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8b81a013-a2c2-418a-9ef0-608a4de78a0b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:42.313625 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8b81a013-a2c2-418a-9ef0-608a4de78a0b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:42.314417 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8b81a013-a2c2-418a-9ef0-608a4de78a0b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:42.314855 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8b81a013-a2c2-418a-9ef0-608a4de78a0b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:42.451726 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-8b81a013-a2c2-418a-9ef0-608a4de78a0b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:42.460395 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-8b81a013-a2c2-418a-9ef0-608a4de78a0b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1520 microversion: 2.1 time: 0.157934 Jul 20 15:33:42.460983 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 108/221] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:42 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:43.478542 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-55aaf95c-c728-4030-be99-076f704caba2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:43.479416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-55aaf95c-c728-4030-be99-076f704caba2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:43.486840 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-55aaf95c-c728-4030-be99-076f704caba2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:43.487286 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-55aaf95c-c728-4030-be99-076f704caba2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:43.488044 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-55aaf95c-c728-4030-be99-076f704caba2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:43.488467 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-55aaf95c-c728-4030-be99-076f704caba2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:43.642825 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-55aaf95c-c728-4030-be99-076f704caba2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:43.650487 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-55aaf95c-c728-4030-be99-076f704caba2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1520 microversion: 2.1 time: 0.175777 Jul 20 15:33:43.651017 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 114/222] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:43 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:44.662494 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e3111f1f-c163-4f84-9164-39f649e24045 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:44.663955 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e3111f1f-c163-4f84-9164-39f649e24045 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:44.668100 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ed31f6ef-a19c-471c-9b56-c97336822345 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:44.668850 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ed31f6ef-a19c-471c-9b56-c97336822345 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:44.672674 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e3111f1f-c163-4f84-9164-39f649e24045 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:44.673121 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e3111f1f-c163-4f84-9164-39f649e24045 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:44.674087 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e3111f1f-c163-4f84-9164-39f649e24045 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:44.674639 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e3111f1f-c163-4f84-9164-39f649e24045 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:44.676431 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ed31f6ef-a19c-471c-9b56-c97336822345 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:44.676877 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ed31f6ef-a19c-471c-9b56-c97336822345 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:44.677807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ed31f6ef-a19c-471c-9b56-c97336822345 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:44.678433 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ed31f6ef-a19c-471c-9b56-c97336822345 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:44.708132 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-e3111f1f-c163-4f84-9164-39f649e24045 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a/ips" status: 200 len: 145 microversion: 2.1 time: 0.049474 Jul 20 15:33:44.709020 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 109/223] 10.222.0.78 () {58 vars in 1247 bytes} [Wed Jul 20 15:33:44 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a/ips => generated 145 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:33:44.855220 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-ed31f6ef-a19c-471c-9b56-c97336822345 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:44.861362 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-ed31f6ef-a19c-471c-9b56-c97336822345 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1520 microversion: 2.1 time: 0.197304 Jul 20 15:33:44.861947 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 115/224] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:44 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:45.879581 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-7ef4a404-192e-46d4-b8f8-1ff1bd40976d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:45.880295 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-7ef4a404-192e-46d4-b8f8-1ff1bd40976d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:45.886809 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7ef4a404-192e-46d4-b8f8-1ff1bd40976d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:45.887256 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7ef4a404-192e-46d4-b8f8-1ff1bd40976d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:45.888021 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7ef4a404-192e-46d4-b8f8-1ff1bd40976d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:45.889184 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7ef4a404-192e-46d4-b8f8-1ff1bd40976d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:46.030518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-7ef4a404-192e-46d4-b8f8-1ff1bd40976d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:46.038485 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-7ef4a404-192e-46d4-b8f8-1ff1bd40976d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1520 microversion: 2.1 time: 0.162944 Jul 20 15:33:46.039054 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 110/225] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:45 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:47.055899 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5ed64e1d-d01c-475b-b3f1-0f0fd0d2b51b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:47.056629 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5ed64e1d-d01c-475b-b3f1-0f0fd0d2b51b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:47.058791 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=26 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:47.063805 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5ed64e1d-d01c-475b-b3f1-0f0fd0d2b51b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:47.064256 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5ed64e1d-d01c-475b-b3f1-0f0fd0d2b51b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:47.065038 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5ed64e1d-d01c-475b-b3f1-0f0fd0d2b51b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:47.065472 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5ed64e1d-d01c-475b-b3f1-0f0fd0d2b51b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:47.210592 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5ed64e1d-d01c-475b-b3f1-0f0fd0d2b51b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:47.221898 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5ed64e1d-d01c-475b-b3f1-0f0fd0d2b51b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1520 microversion: 2.1 time: 0.169438 Jul 20 15:33:47.223885 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 116/226] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:47 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:48.244098 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-fb347d63-36ac-4a53-b9c4-e81c6f8494ab tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:48.245885 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-fb347d63-36ac-4a53-b9c4-e81c6f8494ab tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:48.253938 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fb347d63-36ac-4a53-b9c4-e81c6f8494ab tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:48.254495 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fb347d63-36ac-4a53-b9c4-e81c6f8494ab tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:48.255291 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fb347d63-36ac-4a53-b9c4-e81c6f8494ab tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:48.255875 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fb347d63-36ac-4a53-b9c4-e81c6f8494ab tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:48.422055 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-fb347d63-36ac-4a53-b9c4-e81c6f8494ab tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:48.430601 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-fb347d63-36ac-4a53-b9c4-e81c6f8494ab tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1520 microversion: 2.1 time: 0.194373 Jul 20 15:33:48.431480 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 111/227] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:48 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:33:48.704855 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-1da20be9-aa6e-4716-8503-25d304ca5a88 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1100061b-09d3-4fef-816b-d76241f39ef0"}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:33:48.705961 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-1da20be9-aa6e-4716-8503-25d304ca5a88 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:48.712127 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1da20be9-aa6e-4716-8503-25d304ca5a88 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:48.712564 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1da20be9-aa6e-4716-8503-25d304ca5a88 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:48.713574 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1da20be9-aa6e-4716-8503-25d304ca5a88 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:48.714001 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1da20be9-aa6e-4716-8503-25d304ca5a88 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:49.448835 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-5810bc7f-0e32-41d4-919c-a3e7a91b8dfb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:49.450225 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-5810bc7f-0e32-41d4-919c-a3e7a91b8dfb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:49.457088 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5810bc7f-0e32-41d4-919c-a3e7a91b8dfb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:49.457621 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5810bc7f-0e32-41d4-919c-a3e7a91b8dfb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:49.458522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5810bc7f-0e32-41d4-919c-a3e7a91b8dfb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:49.458959 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5810bc7f-0e32-41d4-919c-a3e7a91b8dfb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:49.463709 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:49.627971 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-5810bc7f-0e32-41d4-919c-a3e7a91b8dfb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:49.637642 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-5810bc7f-0e32-41d4-919c-a3e7a91b8dfb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1520 microversion: 2.1 time: 0.192685 Jul 20 15:33:49.638844 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 112/228] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:49 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:33:49.978701 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-1da20be9-aa6e-4716-8503-25d304ca5a88 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "POST /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.278336 Jul 20 15:33:49.979405 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 117/229] 10.222.0.78 () {60 vars in 1322 bytes} [Wed Jul 20 15:33:48 2022] POST /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a/os-volume_attachments => generated 194 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:33:50.658450 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-8f21b5c6-e620-4757-ab9e-a864c6ef05cd tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:50.659174 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-8f21b5c6-e620-4757-ab9e-a864c6ef05cd tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:50.667406 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8f21b5c6-e620-4757-ab9e-a864c6ef05cd tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:50.667840 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8f21b5c6-e620-4757-ab9e-a864c6ef05cd tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:50.668618 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8f21b5c6-e620-4757-ab9e-a864c6ef05cd tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:50.669049 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8f21b5c6-e620-4757-ab9e-a864c6ef05cd tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:50.860687 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-8f21b5c6-e620-4757-ab9e-a864c6ef05cd tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:50.872963 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-8f21b5c6-e620-4757-ab9e-a864c6ef05cd tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1520 microversion: 2.1 time: 0.219674 Jul 20 15:33:50.874187 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 113/230] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:50 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:51.895246 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-b104c6b1-d7bf-4624-b148-eed160af120f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:51.896045 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-b104c6b1-d7bf-4624-b148-eed160af120f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:51.902950 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b104c6b1-d7bf-4624-b148-eed160af120f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:51.903401 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b104c6b1-d7bf-4624-b148-eed160af120f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:51.904664 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b104c6b1-d7bf-4624-b148-eed160af120f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:51.905099 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b104c6b1-d7bf-4624-b148-eed160af120f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:52.102990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-b104c6b1-d7bf-4624-b148-eed160af120f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:52.111576 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-b104c6b1-d7bf-4624-b148-eed160af120f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1500 microversion: 2.1 time: 0.221227 Jul 20 15:33:52.112169 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 118/231] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:51 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1500 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:52.132217 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-5a297fb1-02c4-46c5-9c2c-e8235841103a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d34a87ca-92a1-4435-84bc-84476492408a"}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:33:52.133924 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-5a297fb1-02c4-46c5-9c2c-e8235841103a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:52.144216 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5a297fb1-02c4-46c5-9c2c-e8235841103a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:52.144856 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5a297fb1-02c4-46c5-9c2c-e8235841103a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:52.145987 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5a297fb1-02c4-46c5-9c2c-e8235841103a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:52.146625 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5a297fb1-02c4-46c5-9c2c-e8235841103a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:52.172416 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-5a297fb1-02c4-46c5-9c2c-e8235841103a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] HTTP exception thrown: Cannot 'attach_volume' instance e0e200ad-ac34-4618-9518-9cc89ec380de while it is in vm_state rescued Jul 20 15:33:52.174123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-5a297fb1-02c4-46c5-9c2c-e8235841103a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Request method failure captured: Jul 20 15:33:52.174123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: POST /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de/os-volume_attachments HTTP/1.1 Jul 20 15:33:52.174123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:33:52.174123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:33:52.174123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:33:52.174123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 74 Jul 20 15:33:52.174123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:33:52.174123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:33:52.174123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:33:52.174123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:33:52.174123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2B_nGe2iOCK4tpUXv7QabEEnZaZW6RYPqleka0psoTfCGUPxAgJvaFOHiUD5txfR4A4Hv1RzSFAd2v9PbHR17R2ddNfAKs2jQu_tXTgNRWpbrjgsTUb2vYhREm-bYeMJTibFF78_Vxw9bGxCNNDb--ZMo_XhlRZwYM49r3qyh0pb7pM Jul 20 15:33:52.174123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:33:52.174123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:33:52.174123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:33:52.174123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:33:52.174123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:33:52.174123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:33:52.174123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 61872ef687074f5791a2cc46732bebdf Jul 20 15:33:52.174123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1769185307 Jul 20 15:33:52.174123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:33:52.174123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:33:52.175667 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/61872ef687074f5791a2cc46732bebdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/61872ef687074f5791a2cc46732bebdf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_61872ef687074f5791a2cc46732bebdf", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/61872ef687074f5791a2cc46732bebdf"}]}] Jul 20 15:33:52.175667 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1769185307 Jul 20 15:33:52.175667 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 61872ef687074f5791a2cc46732bebdf Jul 20 15:33:52.175667 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1769185307 Jul 20 15:33:52.175667 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-ServerRescueNegativeTestJSON-1769185307-project Jul 20 15:33:52.175667 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:33:52.175667 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:33:52.175667 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: ebbcfe6341a3486d93e12c09f83954dc Jul 20 15:33:52.175667 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1769185307-project Jul 20 15:33:52.175667 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Jul 20 15:33:52.175667 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {"volumeAttachment": {"volumeId": "d34a87ca-92a1-4435-84bc-84476492408a"}} Jul 20 15:33:52.175667 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:33:52.180375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Cannot 'attach_volume' instance e0e200ad-ac34-4618-9518-9cc89ec380de while it is in vm_state rescued Jul 20 15:33:52.180375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'server_id': 'e0e200ad-ac34-4618-9518-9cc89ec380de', 'body': {'volumeAttachment': {'volumeId': 'd34a87ca-92a1-4435-84bc-84476492408a'}}} Jul 20 15:33:52.180375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:33:52.180375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:33:52.180375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 15:33:52.180375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 15:33:52.180375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 15:33:52.180375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 15:33:52.180375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 15:33:52.180375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 15:33:52.180375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e0e200ad-ac34-4618-9518-9cc89ec380de in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 20 15:33:52.180375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:33:52.180375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:33:52.180375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:33:52.180375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:33:52.180375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:33:52.180375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:33:52.180375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:33:52.180375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:33:52.181509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:33:52.181509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:33:52.181509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 15:33:52.181509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 15:33:52.181509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 15:33:52.181509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 15:33:52.181509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 15:33:52.181509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 15:33:52.181509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 20 15:33:52.181509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 15:33:52.181509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 15:33:52.181509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 15:33:52.181509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e0e200ad-ac34-4618-9518-9cc89ec380de while it is in vm_state rescued Jul 20 15:33:52.181509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:33:52.181509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:33:52.181509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:33:52.181509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:33:52.181509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:33:52.181509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:33:52.182557 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:33:52.182557 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:33:52.182557 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e0e200ad-ac34-4618-9518-9cc89ec380de while it is in vm_state rescued Jul 20 15:33:52.182557 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:33:52.182557 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-5a297fb1-02c4-46c5-9c2c-e8235841103a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Returning 409 to user: Cannot 'attach_volume' instance e0e200ad-ac34-4618-9518-9cc89ec380de while it is in vm_state rescued {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:33:52.182557 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-5a297fb1-02c4-46c5-9c2c-e8235841103a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "POST /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050360 Jul 20 15:33:52.182557 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 114/232] 10.222.0.78 () {60 vars in 1322 bytes} [Wed Jul 20 15:33:52 2022] POST /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 15:33:52.186080 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-0c76cef2-655a-4914-bdaf-ac6f68ef914e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:33:52.186631 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-0c76cef2-655a-4914-bdaf-ac6f68ef914e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:52.194414 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0c76cef2-655a-4914-bdaf-ac6f68ef914e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:52.194414 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0c76cef2-655a-4914-bdaf-ac6f68ef914e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:52.195789 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0c76cef2-655a-4914-bdaf-ac6f68ef914e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:52.195789 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0c76cef2-655a-4914-bdaf-ac6f68ef914e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:52.541599 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-0c76cef2-655a-4914-bdaf-ac6f68ef914e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "POST /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de/action" status: 202 len: 0 microversion: 2.1 time: 0.359572 Jul 20 15:33:52.543049 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 119/233] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Jul 20 15:33:52 2022] POST /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:33:52.556016 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-222f9dd8-807e-46f1-9637-5ef0b98742bb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:52.556723 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-222f9dd8-807e-46f1-9637-5ef0b98742bb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:52.564743 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-222f9dd8-807e-46f1-9637-5ef0b98742bb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:52.565192 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-222f9dd8-807e-46f1-9637-5ef0b98742bb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:52.566456 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-222f9dd8-807e-46f1-9637-5ef0b98742bb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:52.566601 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-222f9dd8-807e-46f1-9637-5ef0b98742bb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:52.710121 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-222f9dd8-807e-46f1-9637-5ef0b98742bb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:52.718967 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-222f9dd8-807e-46f1-9637-5ef0b98742bb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1508 microversion: 2.1 time: 0.171396 Jul 20 15:33:52.719592 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 115/234] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:52 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:53.738131 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-dc09c889-b13a-4727-a659-bebb34680c7b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:53.739017 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-dc09c889-b13a-4727-a659-bebb34680c7b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:53.746375 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dc09c889-b13a-4727-a659-bebb34680c7b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:53.746375 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dc09c889-b13a-4727-a659-bebb34680c7b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:53.749159 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dc09c889-b13a-4727-a659-bebb34680c7b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:53.749159 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dc09c889-b13a-4727-a659-bebb34680c7b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:53.893504 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-dc09c889-b13a-4727-a659-bebb34680c7b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:53.897553 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:53.902501 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-dc09c889-b13a-4727-a659-bebb34680c7b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1508 microversion: 2.1 time: 0.169554 Jul 20 15:33:53.903085 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 120/235] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:53 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:54.920804 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-3c15db00-41d0-4d0f-b358-c7b4e2b05d1c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:54.921471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-3c15db00-41d0-4d0f-b358-c7b4e2b05d1c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:54.929340 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=32 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:33:54.931381 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3c15db00-41d0-4d0f-b358-c7b4e2b05d1c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:54.932280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3c15db00-41d0-4d0f-b358-c7b4e2b05d1c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:54.933048 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3c15db00-41d0-4d0f-b358-c7b4e2b05d1c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:54.933686 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3c15db00-41d0-4d0f-b358-c7b4e2b05d1c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:55.143377 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-3c15db00-41d0-4d0f-b358-c7b4e2b05d1c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:55.152621 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-3c15db00-41d0-4d0f-b358-c7b4e2b05d1c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1508 microversion: 2.1 time: 0.236089 Jul 20 15:33:55.153497 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 116/236] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:54 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1508 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:56.180199 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-8cdde5ab-e5b2-4fd5-a95d-8dd7132d88e7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:56.180975 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-8cdde5ab-e5b2-4fd5-a95d-8dd7132d88e7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:56.189177 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8cdde5ab-e5b2-4fd5-a95d-8dd7132d88e7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:56.189879 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8cdde5ab-e5b2-4fd5-a95d-8dd7132d88e7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:56.191237 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8cdde5ab-e5b2-4fd5-a95d-8dd7132d88e7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:56.191950 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8cdde5ab-e5b2-4fd5-a95d-8dd7132d88e7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:56.365834 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-8cdde5ab-e5b2-4fd5-a95d-8dd7132d88e7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:56.373818 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-8cdde5ab-e5b2-4fd5-a95d-8dd7132d88e7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1508 microversion: 2.1 time: 0.198132 Jul 20 15:33:56.374437 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 121/237] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:56 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:57.391947 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-2a031e87-90ed-4e1f-a9b3-766365c25e05 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:57.392679 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-2a031e87-90ed-4e1f-a9b3-766365c25e05 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:57.399504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2a031e87-90ed-4e1f-a9b3-766365c25e05 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:57.400655 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2a031e87-90ed-4e1f-a9b3-766365c25e05 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:57.401426 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2a031e87-90ed-4e1f-a9b3-766365c25e05 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:57.401967 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2a031e87-90ed-4e1f-a9b3-766365c25e05 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:57.536099 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-2a031e87-90ed-4e1f-a9b3-766365c25e05 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:57.543999 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-2a031e87-90ed-4e1f-a9b3-766365c25e05 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1508 microversion: 2.1 time: 0.155972 Jul 20 15:33:57.545072 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 117/238] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:57 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:33:58.076570 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d12ed6cf-3f3d-42b7-8ca7-b02d93c7d729 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:58.077036 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-d12ed6cf-3f3d-42b7-8ca7-b02d93c7d729 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:58.083826 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d12ed6cf-3f3d-42b7-8ca7-b02d93c7d729 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:58.084268 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d12ed6cf-3f3d-42b7-8ca7-b02d93c7d729 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:58.085022 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d12ed6cf-3f3d-42b7-8ca7-b02d93c7d729 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:58.085736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d12ed6cf-3f3d-42b7-8ca7-b02d93c7d729 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:58.114627 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d12ed6cf-3f3d-42b7-8ca7-b02d93c7d729 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/ips" status: 200 len: 151 microversion: 2.20 time: 0.042650 Jul 20 15:33:58.115206 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 122/239] 10.222.0.78 () {60 vars in 1288 bytes} [Wed Jul 20 15:33:58 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/ips => generated 151 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 15:33:58.561285 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-2e8419b3-0296-424d-82f0-95bfe93be414 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:58.561888 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-2e8419b3-0296-424d-82f0-95bfe93be414 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:58.568451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2e8419b3-0296-424d-82f0-95bfe93be414 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:58.568901 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2e8419b3-0296-424d-82f0-95bfe93be414 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:58.569689 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2e8419b3-0296-424d-82f0-95bfe93be414 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:58.570104 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2e8419b3-0296-424d-82f0-95bfe93be414 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:58.711916 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-2e8419b3-0296-424d-82f0-95bfe93be414 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:33:58.726875 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-2e8419b3-0296-424d-82f0-95bfe93be414 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1508 microversion: 2.1 time: 0.169107 Jul 20 15:33:58.727655 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 118/240] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:58 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:33:59.760651 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-6ae6ef8a-20d6-4d64-869a-5e1032a5574e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:33:59.761907 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-6ae6ef8a-20d6-4d64-869a-5e1032a5574e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:33:59.774745 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6ae6ef8a-20d6-4d64-869a-5e1032a5574e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:59.775519 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6ae6ef8a-20d6-4d64-869a-5e1032a5574e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:33:59.777064 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6ae6ef8a-20d6-4d64-869a-5e1032a5574e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:33:59.778046 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6ae6ef8a-20d6-4d64-869a-5e1032a5574e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:00.030614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-6ae6ef8a-20d6-4d64-869a-5e1032a5574e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:00.038785 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-6ae6ef8a-20d6-4d64-869a-5e1032a5574e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1508 microversion: 2.1 time: 0.286311 Jul 20 15:34:00.048480 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 123/241] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:33:59 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1508 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:01.057111 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-326e186b-f5c3-4a11-8816-8db9af1493a2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:01.057696 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-326e186b-f5c3-4a11-8816-8db9af1493a2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:01.064390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-326e186b-f5c3-4a11-8816-8db9af1493a2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:01.065038 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-326e186b-f5c3-4a11-8816-8db9af1493a2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:01.065799 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-326e186b-f5c3-4a11-8816-8db9af1493a2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:01.066234 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-326e186b-f5c3-4a11-8816-8db9af1493a2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:01.219024 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-326e186b-f5c3-4a11-8816-8db9af1493a2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:01.227609 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-326e186b-f5c3-4a11-8816-8db9af1493a2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1514 microversion: 2.1 time: 0.174422 Jul 20 15:34:01.228287 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 119/242] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:01 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:01.348966 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-da52a145-ab3e-4cb3-968b-0e2c24a9ec1d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:34:01.349501 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-da52a145-ab3e-4cb3-968b-0e2c24a9ec1d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:01.358160 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-da52a145-ab3e-4cb3-968b-0e2c24a9ec1d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:01.358662 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-da52a145-ab3e-4cb3-968b-0e2c24a9ec1d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:01.360400 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-da52a145-ab3e-4cb3-968b-0e2c24a9ec1d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:01.361509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-da52a145-ab3e-4cb3-968b-0e2c24a9ec1d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:01.400864 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.objects.instance [None req-da52a145-ab3e-4cb3-968b-0e2c24a9ec1d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lazy-loading 'flavor' on Instance uuid f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 {{(pid=124711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:34:02.023168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-da52a145-ab3e-4cb3-968b-0e2c24a9ec1d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "POST /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/action" status: 202 len: 0 microversion: 2.20 time: 0.677963 Jul 20 15:34:02.023955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 124/243] 10.222.0.78 () {62 vars in 1318 bytes} [Wed Jul 20 15:34:01 2022] POST /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/action => generated 0 bytes in 679 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 15:34:02.033857 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-044e2f73-8faa-4efd-b4c0-a2165a4175e5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:02.034744 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-044e2f73-8faa-4efd-b4c0-a2165a4175e5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:02.041259 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-044e2f73-8faa-4efd-b4c0-a2165a4175e5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:02.041716 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-044e2f73-8faa-4efd-b4c0-a2165a4175e5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:02.042517 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-044e2f73-8faa-4efd-b4c0-a2165a4175e5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:02.042946 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-044e2f73-8faa-4efd-b4c0-a2165a4175e5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:02.215960 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-044e2f73-8faa-4efd-b4c0-a2165a4175e5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:02.224334 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-044e2f73-8faa-4efd-b4c0-a2165a4175e5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:02.229295 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-044e2f73-8faa-4efd-b4c0-a2165a4175e5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:02.229295 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-044e2f73-8faa-4efd-b4c0-a2165a4175e5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.198198 Jul 20 15:34:02.229295 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 120/244] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:02 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:03.252661 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-92a34f0e-5a7b-424d-b389-46f9e841b058 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:03.253360 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-92a34f0e-5a7b-424d-b389-46f9e841b058 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:03.259672 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-92a34f0e-5a7b-424d-b389-46f9e841b058 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:03.260122 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-92a34f0e-5a7b-424d-b389-46f9e841b058 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:03.260874 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-92a34f0e-5a7b-424d-b389-46f9e841b058 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:03.261308 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-92a34f0e-5a7b-424d-b389-46f9e841b058 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:03.417037 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-92a34f0e-5a7b-424d-b389-46f9e841b058 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:03.425010 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-92a34f0e-5a7b-424d-b389-46f9e841b058 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:03.426542 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-92a34f0e-5a7b-424d-b389-46f9e841b058 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:03.427689 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-92a34f0e-5a7b-424d-b389-46f9e841b058 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.179858 Jul 20 15:34:03.428309 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 125/245] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:03 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:04.444825 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-eaf3ef31-5d50-483c-b2f0-bcfde6284e0d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:04.445596 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-eaf3ef31-5d50-483c-b2f0-bcfde6284e0d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:04.451727 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-eaf3ef31-5d50-483c-b2f0-bcfde6284e0d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:04.452168 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-eaf3ef31-5d50-483c-b2f0-bcfde6284e0d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:04.452969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-eaf3ef31-5d50-483c-b2f0-bcfde6284e0d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:04.453648 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-eaf3ef31-5d50-483c-b2f0-bcfde6284e0d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:04.592094 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-eaf3ef31-5d50-483c-b2f0-bcfde6284e0d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:04.600212 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-eaf3ef31-5d50-483c-b2f0-bcfde6284e0d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:04.601854 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-eaf3ef31-5d50-483c-b2f0-bcfde6284e0d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:04.603093 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-eaf3ef31-5d50-483c-b2f0-bcfde6284e0d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.162112 Jul 20 15:34:04.603701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 121/246] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:04 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:05.621400 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-1266547d-a6c4-49ef-bd47-f6349b3aebf5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:05.622015 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-1266547d-a6c4-49ef-bd47-f6349b3aebf5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:05.628486 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1266547d-a6c4-49ef-bd47-f6349b3aebf5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:05.631542 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1266547d-a6c4-49ef-bd47-f6349b3aebf5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:05.631542 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1266547d-a6c4-49ef-bd47-f6349b3aebf5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:05.631542 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1266547d-a6c4-49ef-bd47-f6349b3aebf5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:05.783163 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-1266547d-a6c4-49ef-bd47-f6349b3aebf5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:05.793323 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-1266547d-a6c4-49ef-bd47-f6349b3aebf5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:05.795018 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-1266547d-a6c4-49ef-bd47-f6349b3aebf5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:05.796186 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-1266547d-a6c4-49ef-bd47-f6349b3aebf5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.178686 Jul 20 15:34:05.807505 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 126/247] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:05 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:06.602462 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-f558a459-1ed5-42ef-beb3-404b72c0f766 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Action: 'create', calling method: .version_select at 0x7efd91492280>, body: {"keypair": {"name": "tempest-keypair-1783439801", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHWXYtnlExJ9C9/hkZOtLhSrnJIXOZf/Lwtiju9Ec0fSxKeGC+m/iuweKq1Pq/AmgcIZyPutgOyDB75UVPWN+6C7eGE0YtWXZyE1Y30reoZMLZD8kmEW1RIwNVPsu3BQ0A=="}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:34:06.617912 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-f558a459-1ed5-42ef-beb3-404b72c0f766 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Getting quotas for project 61872ef687074f5791a2cc46732bebdf. Resources: {'key_pairs'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:34:06.622407 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-f558a459-1ed5-42ef-beb3-404b72c0f766 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Getting quotas for user ebbcfe6341a3486d93e12c09f83954dc and project 61872ef687074f5791a2cc46732bebdf. Resources: {'key_pairs'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:34:06.787346 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-f558a459-1ed5-42ef-beb3-404b72c0f766 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.196709 Jul 20 15:34:06.788775 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 122/248] 10.222.0.78 () {60 vars in 1158 bytes} [Wed Jul 20 15:34:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:34:06.819855 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-99709825-dc74-4e81-acf0-4309bc6929d6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:06.820510 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-99709825-dc74-4e81-acf0-4309bc6929d6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:06.830806 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-99709825-dc74-4e81-acf0-4309bc6929d6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:06.832063 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-99709825-dc74-4e81-acf0-4309bc6929d6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:06.833579 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-99709825-dc74-4e81-acf0-4309bc6929d6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:06.834291 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-99709825-dc74-4e81-acf0-4309bc6929d6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:07.063343 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-99709825-dc74-4e81-acf0-4309bc6929d6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:07.079602 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-99709825-dc74-4e81-acf0-4309bc6929d6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:07.087453 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-99709825-dc74-4e81-acf0-4309bc6929d6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:07.090489 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-99709825-dc74-4e81-acf0-4309bc6929d6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.277801 Jul 20 15:34:07.093751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 127/249] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:06 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:07.098324 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e6a03215-1085-4aba-bd7b-5f8c6745fb94 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:34:07.106489 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e6a03215-1085-4aba-bd7b-5f8c6745fb94 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:07.108013 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e6a03215-1085-4aba-bd7b-5f8c6745fb94 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:07.172623 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e6a03215-1085-4aba-bd7b-5f8c6745fb94 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Going to try to stop instance {{(pid=124712) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 15:34:07.461173 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-e6a03215-1085-4aba-bd7b-5f8c6745fb94 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "POST /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a/action" status: 202 len: 0 microversion: 2.1 time: 0.366655 Jul 20 15:34:07.468764 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 123/250] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Jul 20 15:34:07 2022] POST /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 15:34:07.472867 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-2c0eec86-e9a2-45ef-83b3-2bc97b1eedbd tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:07.474086 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-2c0eec86-e9a2-45ef-83b3-2bc97b1eedbd tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:07.481352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2c0eec86-e9a2-45ef-83b3-2bc97b1eedbd tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:07.482231 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2c0eec86-e9a2-45ef-83b3-2bc97b1eedbd tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:07.483113 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2c0eec86-e9a2-45ef-83b3-2bc97b1eedbd tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:07.483680 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2c0eec86-e9a2-45ef-83b3-2bc97b1eedbd tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:07.657514 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2c0eec86-e9a2-45ef-83b3-2bc97b1eedbd tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:07.665984 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-2c0eec86-e9a2-45ef-83b3-2bc97b1eedbd tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1723 microversion: 2.1 time: 0.197342 Jul 20 15:34:07.670192 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 128/251] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:07 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:08.113014 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-c583267e-4d47-4d54-8f42-6a88ea811335 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:08.113861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-c583267e-4d47-4d54-8f42-6a88ea811335 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:08.121067 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c583267e-4d47-4d54-8f42-6a88ea811335 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:08.121521 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c583267e-4d47-4d54-8f42-6a88ea811335 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:08.122949 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c583267e-4d47-4d54-8f42-6a88ea811335 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:08.123378 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c583267e-4d47-4d54-8f42-6a88ea811335 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:08.289068 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-c583267e-4d47-4d54-8f42-6a88ea811335 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:08.298977 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-c583267e-4d47-4d54-8f42-6a88ea811335 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:08.300477 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-c583267e-4d47-4d54-8f42-6a88ea811335 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:08.301725 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-c583267e-4d47-4d54-8f42-6a88ea811335 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.194090 Jul 20 15:34:08.302626 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 124/252] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:08 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:08.683516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-9bff478b-1d04-49ea-ab88-b2dbf2e10c1a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:08.684941 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-9bff478b-1d04-49ea-ab88-b2dbf2e10c1a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:08.692648 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9bff478b-1d04-49ea-ab88-b2dbf2e10c1a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:08.693101 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9bff478b-1d04-49ea-ab88-b2dbf2e10c1a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:08.693933 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9bff478b-1d04-49ea-ab88-b2dbf2e10c1a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:08.694396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9bff478b-1d04-49ea-ab88-b2dbf2e10c1a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:08.877946 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-9bff478b-1d04-49ea-ab88-b2dbf2e10c1a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:08.886117 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-9bff478b-1d04-49ea-ab88-b2dbf2e10c1a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1723 microversion: 2.1 time: 0.207054 Jul 20 15:34:08.887218 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 129/253] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:08 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:09.321234 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-8018a53b-496f-4aca-a34a-00946d08cae1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:09.321827 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-8018a53b-496f-4aca-a34a-00946d08cae1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:09.329895 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8018a53b-496f-4aca-a34a-00946d08cae1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:09.330567 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8018a53b-496f-4aca-a34a-00946d08cae1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:09.331458 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8018a53b-496f-4aca-a34a-00946d08cae1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:09.332094 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8018a53b-496f-4aca-a34a-00946d08cae1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:09.571943 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-8018a53b-496f-4aca-a34a-00946d08cae1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:09.581072 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-8018a53b-496f-4aca-a34a-00946d08cae1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:09.583068 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-8018a53b-496f-4aca-a34a-00946d08cae1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:09.584260 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-8018a53b-496f-4aca-a34a-00946d08cae1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.267780 Jul 20 15:34:09.584976 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 125/254] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:09 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:09.907298 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-41415c45-283a-4c93-9837-5fee17f3b4e2 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:09.907298 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-41415c45-283a-4c93-9837-5fee17f3b4e2 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:09.915950 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-41415c45-283a-4c93-9837-5fee17f3b4e2 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:09.916477 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-41415c45-283a-4c93-9837-5fee17f3b4e2 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:09.917515 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-41415c45-283a-4c93-9837-5fee17f3b4e2 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:09.918075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-41415c45-283a-4c93-9837-5fee17f3b4e2 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:10.023797 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e60b8def-ae76-42a2-a9ef-aff86c634bba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-644877313", "imageRef": "80914b1c-623c-42a8-810e-836b2cce0d3b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49eaadcd-4166-45bc-8081-db7a31ee5c71"}], "security_groups": [{"name": "tempest-securitygroup--2605876"}], "key_name": "tempest-keypair-1783439801", "user_data": "}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:34:10.069312 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-41415c45-283a-4c93-9837-5fee17f3b4e2 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:10.078705 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-41415c45-283a-4c93-9837-5fee17f3b4e2 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1723 microversion: 2.1 time: 0.176475 Jul 20 15:34:10.079345 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 130/255] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:09 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:10.142628 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.network.neutron [None req-e60b8def-ae76-42a2-a9ef-aff86c634bba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] validate_networks() for [('49eaadcd-4166-45bc-8081-db7a31ee5c71', None, None, None, None, None)] {{(pid=124712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 15:34:10.563309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-e60b8def-ae76-42a2-a9ef-aff86c634bba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Flavor limits 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 15:34:10.563878 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-e60b8def-ae76-42a2-a9ef-aff86c634bba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Image limits 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 15:34:10.564680 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-e60b8def-ae76-42a2-a9ef-aff86c634bba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Flavor pref 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 15:34:10.565494 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-e60b8def-ae76-42a2-a9ef-aff86c634bba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Image pref 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 15:34:10.566222 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-e60b8def-ae76-42a2-a9ef-aff86c634bba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 15:34:10.578046 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e60b8def-ae76-42a2-a9ef-aff86c634bba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:10.578717 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e60b8def-ae76-42a2-a9ef-aff86c634bba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:10.584530 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e60b8def-ae76-42a2-a9ef-aff86c634bba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:10.584530 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e60b8def-ae76-42a2-a9ef-aff86c634bba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:10.600632 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-e60b8def-ae76-42a2-a9ef-aff86c634bba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Getting quotas for project 61872ef687074f5791a2cc46732bebdf. Resources: {'instances', 'ram', 'cores'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:34:10.603083 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c974213f-82d3-4299-9d88-75b108d33316 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:10.603702 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c974213f-82d3-4299-9d88-75b108d33316 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:10.605214 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-e60b8def-ae76-42a2-a9ef-aff86c634bba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Getting quotas for user ebbcfe6341a3486d93e12c09f83954dc and project 61872ef687074f5791a2cc46732bebdf. Resources: {'instances', 'ram', 'cores'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:34:10.610480 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c974213f-82d3-4299-9d88-75b108d33316 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:10.611354 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c974213f-82d3-4299-9d88-75b108d33316 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:10.615998 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c974213f-82d3-4299-9d88-75b108d33316 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:10.617655 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c974213f-82d3-4299-9d88-75b108d33316 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:10.617777 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e60b8def-ae76-42a2-a9ef-aff86c634bba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Going to run 1 instances... {{(pid=124712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 15:34:10.620155 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e60b8def-ae76-42a2-a9ef-aff86c634bba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80914b1c-623c-42a8-810e-836b2cce0d3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 15:34:10.796341 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-e60b8def-ae76-42a2-a9ef-aff86c634bba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.776714 Jul 20 15:34:10.797146 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 126/256] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Jul 20 15:34:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 15:34:10.807704 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d7e68620-4c63-407f-8c14-0342d20ba590 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:10.808324 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d7e68620-4c63-407f-8c14-0342d20ba590 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:10.811754 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c974213f-82d3-4299-9d88-75b108d33316 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:10.840572 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c974213f-82d3-4299-9d88-75b108d33316 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:10.842975 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c974213f-82d3-4299-9d88-75b108d33316 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:10.844325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c974213f-82d3-4299-9d88-75b108d33316 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.245447 Jul 20 15:34:10.845376 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 131/257] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:10 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:10.888134 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d7e68620-4c63-407f-8c14-0342d20ba590 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:11.102460 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-0123e775-5734-4b08-8976-5d86bcee3b1c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:11.104126 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-0123e775-5734-4b08-8976-5d86bcee3b1c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:11.117996 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0123e775-5734-4b08-8976-5d86bcee3b1c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:11.121099 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0123e775-5734-4b08-8976-5d86bcee3b1c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:11.123632 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0123e775-5734-4b08-8976-5d86bcee3b1c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:11.124384 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0123e775-5734-4b08-8976-5d86bcee3b1c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:11.183566 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-d7e68620-4c63-407f-8c14-0342d20ba590 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1245 microversion: 2.1 time: 0.379930 Jul 20 15:34:11.184852 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 127/258] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:10 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1245 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:34:11.301771 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-0123e775-5734-4b08-8976-5d86bcee3b1c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:11.315428 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-0123e775-5734-4b08-8976-5d86bcee3b1c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1723 microversion: 2.1 time: 0.217669 Jul 20 15:34:11.316698 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 132/259] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:11 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:11.868142 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-0b5a837e-6047-4a8f-b001-dfcc79a774b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:11.868723 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-0b5a837e-6047-4a8f-b001-dfcc79a774b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:11.881022 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0b5a837e-6047-4a8f-b001-dfcc79a774b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:11.881238 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0b5a837e-6047-4a8f-b001-dfcc79a774b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:11.882073 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0b5a837e-6047-4a8f-b001-dfcc79a774b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:11.883712 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0b5a837e-6047-4a8f-b001-dfcc79a774b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:12.079243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-0b5a837e-6047-4a8f-b001-dfcc79a774b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:12.087967 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-0b5a837e-6047-4a8f-b001-dfcc79a774b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:12.090612 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-0b5a837e-6047-4a8f-b001-dfcc79a774b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:12.092124 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-0b5a837e-6047-4a8f-b001-dfcc79a774b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.228616 Jul 20 15:34:12.092660 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 128/260] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:11 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:12.201702 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-4ab2dc6d-51a8-48ec-a110-c6f212ef8023 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:12.202345 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-4ab2dc6d-51a8-48ec-a110-c6f212ef8023 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:12.209461 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4ab2dc6d-51a8-48ec-a110-c6f212ef8023 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:12.209913 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4ab2dc6d-51a8-48ec-a110-c6f212ef8023 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:12.210787 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4ab2dc6d-51a8-48ec-a110-c6f212ef8023 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:12.211351 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4ab2dc6d-51a8-48ec-a110-c6f212ef8023 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:12.279638 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-4ab2dc6d-51a8-48ec-a110-c6f212ef8023 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:12.297602 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-4ab2dc6d-51a8-48ec-a110-c6f212ef8023 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1249 microversion: 2.1 time: 0.100320 Jul 20 15:34:12.298478 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 133/261] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:12 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1249 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:12.336023 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-adaa46ea-0cef-43c2-95d7-ad157e56bd90 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:12.338147 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-adaa46ea-0cef-43c2-95d7-ad157e56bd90 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:12.354739 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-adaa46ea-0cef-43c2-95d7-ad157e56bd90 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:12.355580 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-adaa46ea-0cef-43c2-95d7-ad157e56bd90 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:12.357303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-adaa46ea-0cef-43c2-95d7-ad157e56bd90 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:12.359786 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-adaa46ea-0cef-43c2-95d7-ad157e56bd90 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:12.550934 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-adaa46ea-0cef-43c2-95d7-ad157e56bd90 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:12.562019 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-adaa46ea-0cef-43c2-95d7-ad157e56bd90 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1723 microversion: 2.1 time: 0.232783 Jul 20 15:34:12.563058 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 129/262] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:12 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:13.117249 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e3b92669-917a-4b17-83a1-c2c56f25df1c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:13.118203 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e3b92669-917a-4b17-83a1-c2c56f25df1c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:13.126406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e3b92669-917a-4b17-83a1-c2c56f25df1c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:13.127145 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e3b92669-917a-4b17-83a1-c2c56f25df1c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:13.128114 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e3b92669-917a-4b17-83a1-c2c56f25df1c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:13.128769 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e3b92669-917a-4b17-83a1-c2c56f25df1c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:13.323834 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b3f43467-9227-4ee3-9ecc-69ff15cf6b56 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:13.331494 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b3f43467-9227-4ee3-9ecc-69ff15cf6b56 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:13.331760 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b3f43467-9227-4ee3-9ecc-69ff15cf6b56 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:13.332662 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b3f43467-9227-4ee3-9ecc-69ff15cf6b56 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:13.333700 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b3f43467-9227-4ee3-9ecc-69ff15cf6b56 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:13.334654 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b3f43467-9227-4ee3-9ecc-69ff15cf6b56 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:13.337948 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e3b92669-917a-4b17-83a1-c2c56f25df1c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:13.351029 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e3b92669-917a-4b17-83a1-c2c56f25df1c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:13.353443 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e3b92669-917a-4b17-83a1-c2c56f25df1c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:13.356928 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e3b92669-917a-4b17-83a1-c2c56f25df1c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.243462 Jul 20 15:34:13.357827 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 134/263] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:13 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:13.457043 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b3f43467-9227-4ee3-9ecc-69ff15cf6b56 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:13.459540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:13.469149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b3f43467-9227-4ee3-9ecc-69ff15cf6b56 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1297 microversion: 2.1 time: 0.149538 Jul 20 15:34:13.470008 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 130/264] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:13 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1297 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:34:13.580075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-dcc02b44-8d9d-4aaf-b43d-84b0d9a75860 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:13.580804 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-dcc02b44-8d9d-4aaf-b43d-84b0d9a75860 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:13.587570 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dcc02b44-8d9d-4aaf-b43d-84b0d9a75860 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:13.588423 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dcc02b44-8d9d-4aaf-b43d-84b0d9a75860 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:13.589194 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dcc02b44-8d9d-4aaf-b43d-84b0d9a75860 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:13.589629 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dcc02b44-8d9d-4aaf-b43d-84b0d9a75860 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:13.749741 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-dcc02b44-8d9d-4aaf-b43d-84b0d9a75860 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:13.753429 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:13.759164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-dcc02b44-8d9d-4aaf-b43d-84b0d9a75860 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1723 microversion: 2.1 time: 0.183874 Jul 20 15:34:13.759827 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 135/265] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:13 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:14.383246 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-48f1b282-7f66-46a2-bab0-325807e9edeb tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:14.383888 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-48f1b282-7f66-46a2-bab0-325807e9edeb tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:14.390914 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-48f1b282-7f66-46a2-bab0-325807e9edeb tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:14.391369 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-48f1b282-7f66-46a2-bab0-325807e9edeb tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:14.392134 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-48f1b282-7f66-46a2-bab0-325807e9edeb tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:14.392566 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-48f1b282-7f66-46a2-bab0-325807e9edeb tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:14.489031 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-98b6afa5-aaf8-4eba-853c-f962cc3efa3d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:14.489031 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-98b6afa5-aaf8-4eba-853c-f962cc3efa3d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:14.495731 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-98b6afa5-aaf8-4eba-853c-f962cc3efa3d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:14.496221 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-98b6afa5-aaf8-4eba-853c-f962cc3efa3d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:14.497244 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-98b6afa5-aaf8-4eba-853c-f962cc3efa3d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:14.497685 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-98b6afa5-aaf8-4eba-853c-f962cc3efa3d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:14.553614 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-48f1b282-7f66-46a2-bab0-325807e9edeb tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:14.565690 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-48f1b282-7f66-46a2-bab0-325807e9edeb tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:14.567334 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-48f1b282-7f66-46a2-bab0-325807e9edeb tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:14.568764 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-48f1b282-7f66-46a2-bab0-325807e9edeb tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.189477 Jul 20 15:34:14.569760 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 131/266] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:14 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:14.573494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-98b6afa5-aaf8-4eba-853c-f962cc3efa3d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:14.595151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-98b6afa5-aaf8-4eba-853c-f962cc3efa3d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1297 microversion: 2.1 time: 0.111762 Jul 20 15:34:14.595930 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 136/267] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:14 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1297 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:14.777628 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-bf2cb333-1f6e-403e-be7d-20f12d39ac69 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:14.779122 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-bf2cb333-1f6e-403e-be7d-20f12d39ac69 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:14.785449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bf2cb333-1f6e-403e-be7d-20f12d39ac69 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:14.786115 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bf2cb333-1f6e-403e-be7d-20f12d39ac69 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:14.786914 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bf2cb333-1f6e-403e-be7d-20f12d39ac69 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:14.787349 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bf2cb333-1f6e-403e-be7d-20f12d39ac69 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:14.937770 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-bf2cb333-1f6e-403e-be7d-20f12d39ac69 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:14.946056 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-bf2cb333-1f6e-403e-be7d-20f12d39ac69 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1723 microversion: 2.1 time: 0.173642 Jul 20 15:34:14.950960 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 132/268] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:14 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:34:15.594195 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e1ee2ec1-60f7-4ded-abee-15d5ff58d513 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:15.594996 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e1ee2ec1-60f7-4ded-abee-15d5ff58d513 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:15.606184 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e1ee2ec1-60f7-4ded-abee-15d5ff58d513 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:15.608012 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e1ee2ec1-60f7-4ded-abee-15d5ff58d513 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:15.608815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e1ee2ec1-60f7-4ded-abee-15d5ff58d513 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:15.611377 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e1ee2ec1-60f7-4ded-abee-15d5ff58d513 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:15.617389 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-6820251f-efc5-41e7-939b-534a015ef310 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:15.617389 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-6820251f-efc5-41e7-939b-534a015ef310 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:15.626322 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6820251f-efc5-41e7-939b-534a015ef310 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:15.627909 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6820251f-efc5-41e7-939b-534a015ef310 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:15.628970 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6820251f-efc5-41e7-939b-534a015ef310 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:15.629413 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6820251f-efc5-41e7-939b-534a015ef310 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:15.754303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-6820251f-efc5-41e7-939b-534a015ef310 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:15.764996 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-6820251f-efc5-41e7-939b-534a015ef310 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1297 microversion: 2.1 time: 0.153433 Jul 20 15:34:15.779828 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 133/269] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:15 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1297 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:15.826034 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e1ee2ec1-60f7-4ded-abee-15d5ff58d513 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:15.838412 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e1ee2ec1-60f7-4ded-abee-15d5ff58d513 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:15.844371 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e1ee2ec1-60f7-4ded-abee-15d5ff58d513 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:15.845580 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e1ee2ec1-60f7-4ded-abee-15d5ff58d513 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.259983 Jul 20 15:34:15.846293 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 137/270] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:15 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:15.968475 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-ce2c6698-664b-4477-9f32-aae8c42fbcb8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:15.969398 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-ce2c6698-664b-4477-9f32-aae8c42fbcb8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:15.976333 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ce2c6698-664b-4477-9f32-aae8c42fbcb8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:15.977100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ce2c6698-664b-4477-9f32-aae8c42fbcb8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:15.978877 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ce2c6698-664b-4477-9f32-aae8c42fbcb8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:15.979763 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ce2c6698-664b-4477-9f32-aae8c42fbcb8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:16.229625 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-ce2c6698-664b-4477-9f32-aae8c42fbcb8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:16.239082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-ce2c6698-664b-4477-9f32-aae8c42fbcb8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1723 microversion: 2.1 time: 0.274406 Jul 20 15:34:16.239670 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 134/271] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:15 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:16.783463 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c5d0f75f-5822-4835-8242-d1430967e2d2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:16.784258 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c5d0f75f-5822-4835-8242-d1430967e2d2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:16.796154 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c5d0f75f-5822-4835-8242-d1430967e2d2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:16.796600 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c5d0f75f-5822-4835-8242-d1430967e2d2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:16.797376 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c5d0f75f-5822-4835-8242-d1430967e2d2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:16.797807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c5d0f75f-5822-4835-8242-d1430967e2d2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:16.864362 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-c780dd53-4cd2-499e-9b99-cedbc0807b07 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:16.867301 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-c780dd53-4cd2-499e-9b99-cedbc0807b07 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:16.874512 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c780dd53-4cd2-499e-9b99-cedbc0807b07 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:16.874948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c780dd53-4cd2-499e-9b99-cedbc0807b07 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:16.875747 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c780dd53-4cd2-499e-9b99-cedbc0807b07 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:16.876194 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c780dd53-4cd2-499e-9b99-cedbc0807b07 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:16.888073 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c5d0f75f-5822-4835-8242-d1430967e2d2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:16.912873 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c5d0f75f-5822-4835-8242-d1430967e2d2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1303 microversion: 2.1 time: 0.135365 Jul 20 15:34:16.922580 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 138/272] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:16 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1303 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:17.083038 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-c780dd53-4cd2-499e-9b99-cedbc0807b07 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:17.099546 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-c780dd53-4cd2-499e-9b99-cedbc0807b07 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:17.101813 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-c780dd53-4cd2-499e-9b99-cedbc0807b07 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:17.102536 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-c780dd53-4cd2-499e-9b99-cedbc0807b07 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.242134 Jul 20 15:34:17.103766 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 135/273] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:16 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:34:17.261203 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-854d9ef7-8fcd-44a1-81d6-dfbb393950a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:17.263290 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-854d9ef7-8fcd-44a1-81d6-dfbb393950a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:17.268192 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=46 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:17.275755 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-854d9ef7-8fcd-44a1-81d6-dfbb393950a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:17.275755 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-854d9ef7-8fcd-44a1-81d6-dfbb393950a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:17.276932 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-854d9ef7-8fcd-44a1-81d6-dfbb393950a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:17.277543 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-854d9ef7-8fcd-44a1-81d6-dfbb393950a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:17.553371 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-854d9ef7-8fcd-44a1-81d6-dfbb393950a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:17.582681 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-854d9ef7-8fcd-44a1-81d6-dfbb393950a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1723 microversion: 2.1 time: 0.327155 Jul 20 15:34:17.586286 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 139/274] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:17 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1723 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:17.943707 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-2c9cfe7f-2278-4372-b477-c1fb1fa076a4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:17.943707 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-2c9cfe7f-2278-4372-b477-c1fb1fa076a4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:17.952563 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2c9cfe7f-2278-4372-b477-c1fb1fa076a4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:17.953408 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2c9cfe7f-2278-4372-b477-c1fb1fa076a4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:17.954638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2c9cfe7f-2278-4372-b477-c1fb1fa076a4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:17.963134 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2c9cfe7f-2278-4372-b477-c1fb1fa076a4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:18.134731 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-54569aec-3a89-47ef-8f55-a529c47796d8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:18.138822 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-54569aec-3a89-47ef-8f55-a529c47796d8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:18.175536 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-54569aec-3a89-47ef-8f55-a529c47796d8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:18.177215 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-54569aec-3a89-47ef-8f55-a529c47796d8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:18.179053 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-54569aec-3a89-47ef-8f55-a529c47796d8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:18.179958 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-54569aec-3a89-47ef-8f55-a529c47796d8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:18.441046 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-2c9cfe7f-2278-4372-b477-c1fb1fa076a4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:18.456420 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-2c9cfe7f-2278-4372-b477-c1fb1fa076a4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1368 microversion: 2.1 time: 0.526710 Jul 20 15:34:18.462148 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 136/275] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:17 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1368 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:18.603815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-c4f637b0-cb4a-40d1-90db-52b3a27b1d2e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:18.604434 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-c4f637b0-cb4a-40d1-90db-52b3a27b1d2e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:18.618237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c4f637b0-cb4a-40d1-90db-52b3a27b1d2e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:18.619105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c4f637b0-cb4a-40d1-90db-52b3a27b1d2e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:18.620053 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c4f637b0-cb4a-40d1-90db-52b3a27b1d2e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:18.620675 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c4f637b0-cb4a-40d1-90db-52b3a27b1d2e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:18.722798 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-54569aec-3a89-47ef-8f55-a529c47796d8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:18.767215 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-54569aec-3a89-47ef-8f55-a529c47796d8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:18.771244 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-54569aec-3a89-47ef-8f55-a529c47796d8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:18.775603 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-54569aec-3a89-47ef-8f55-a529c47796d8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.656280 Jul 20 15:34:18.800791 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 140/276] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:18 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:34:19.017246 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-c4f637b0-cb4a-40d1-90db-52b3a27b1d2e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:19.069128 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-c4f637b0-cb4a-40d1-90db-52b3a27b1d2e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1723 microversion: 2.1 time: 0.469340 Jul 20 15:34:19.080182 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 137/277] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:18 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1723 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:19.481408 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-6bca962b-2e19-439d-a6d7-ce3fba3c271d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:19.482533 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-6bca962b-2e19-439d-a6d7-ce3fba3c271d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:19.497920 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6bca962b-2e19-439d-a6d7-ce3fba3c271d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:19.502545 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6bca962b-2e19-439d-a6d7-ce3fba3c271d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:19.507883 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6bca962b-2e19-439d-a6d7-ce3fba3c271d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:19.508551 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6bca962b-2e19-439d-a6d7-ce3fba3c271d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:19.807523 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-468dc090-0cf6-4190-a778-ef675bdde01e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:19.808384 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-468dc090-0cf6-4190-a778-ef675bdde01e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:19.822081 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-468dc090-0cf6-4190-a778-ef675bdde01e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:19.822806 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-468dc090-0cf6-4190-a778-ef675bdde01e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:19.827238 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-468dc090-0cf6-4190-a778-ef675bdde01e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:19.827920 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-468dc090-0cf6-4190-a778-ef675bdde01e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:20.566087 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-6bca962b-2e19-439d-a6d7-ce3fba3c271d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:20.578905 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-468dc090-0cf6-4190-a778-ef675bdde01e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:20.582074 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-6bca962b-2e19-439d-a6d7-ce3fba3c271d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1368 microversion: 2.1 time: 1.109072 Jul 20 15:34:20.586288 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 141/278] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:19 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1368 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:20.591279 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=2 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:20.598129 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-468dc090-0cf6-4190-a778-ef675bdde01e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:20.599721 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-468dc090-0cf6-4190-a778-ef675bdde01e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:20.601663 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-7716af01-1fee-4499-8598-a494013acdd1 req-3890df4b-f74c-4231-ae07-fb1ccabd8082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91beb453-6320-472a-951c-3fda16747994", "tag": "e2135397-d828-46e2-a219-f788f406eb08"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:34:20.613952 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-468dc090-0cf6-4190-a778-ef675bdde01e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.810948 Jul 20 15:34:20.616681 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 138/279] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:19 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:34:20.622943 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-7716af01-1fee-4499-8598-a494013acdd1 req-3890df4b-f74c-4231-ae07-fb1ccabd8082 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:20.625484 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-7716af01-1fee-4499-8598-a494013acdd1 req-3890df4b-f74c-4231-ae07-fb1ccabd8082 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:20.638417 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e66c43d2-c23a-4792-908b-0ad93bd1820b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:20.638975 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e66c43d2-c23a-4792-908b-0ad93bd1820b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:20.664814 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e66c43d2-c23a-4792-908b-0ad93bd1820b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:20.665346 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e66c43d2-c23a-4792-908b-0ad93bd1820b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:20.666242 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e66c43d2-c23a-4792-908b-0ad93bd1820b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:20.666708 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e66c43d2-c23a-4792-908b-0ad93bd1820b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:20.673276 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-7716af01-1fee-4499-8598-a494013acdd1 req-3890df4b-f74c-4231-ae07-fb1ccabd8082 service nova] Creating event network-changed:e2135397-d828-46e2-a219-f788f406eb08 for instance 91beb453-6320-472a-951c-3fda16747994 on hv-cinder-81914 Jul 20 15:34:20.689376 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-7716af01-1fee-4499-8598-a494013acdd1 req-3890df4b-f74c-4231-ae07-fb1ccabd8082 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101582 Jul 20 15:34:20.690395 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 142/280] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:34:20.926063 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-e66c43d2-c23a-4792-908b-0ad93bd1820b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:20.935531 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-e66c43d2-c23a-4792-908b-0ad93bd1820b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1723 microversion: 2.1 time: 0.314979 Jul 20 15:34:20.936227 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 139/281] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:20 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:21.601806 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-cb2c1f3a-642b-4ebe-9d81-1a391c05f713 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:21.603058 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-cb2c1f3a-642b-4ebe-9d81-1a391c05f713 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:21.611023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cb2c1f3a-642b-4ebe-9d81-1a391c05f713 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:21.611608 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cb2c1f3a-642b-4ebe-9d81-1a391c05f713 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:21.612475 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cb2c1f3a-642b-4ebe-9d81-1a391c05f713 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:21.613117 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cb2c1f3a-642b-4ebe-9d81-1a391c05f713 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:21.634835 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-247be974-a651-4b89-86ad-8c8e75562093 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:21.635435 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-247be974-a651-4b89-86ad-8c8e75562093 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:21.638301 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=12 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:21.643691 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-247be974-a651-4b89-86ad-8c8e75562093 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:21.644138 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-247be974-a651-4b89-86ad-8c8e75562093 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:21.644893 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-247be974-a651-4b89-86ad-8c8e75562093 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:21.645702 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-247be974-a651-4b89-86ad-8c8e75562093 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:21.851262 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-cb2c1f3a-642b-4ebe-9d81-1a391c05f713 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:21.862999 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-cb2c1f3a-642b-4ebe-9d81-1a391c05f713 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1368 microversion: 2.1 time: 0.265434 Jul 20 15:34:21.864076 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 143/282] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:21 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1368 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:34:21.928228 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-247be974-a651-4b89-86ad-8c8e75562093 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:21.948901 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-247be974-a651-4b89-86ad-8c8e75562093 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:21.954981 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-73c16ece-34a0-4de8-84cc-dbd10f6421b3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:21.955704 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-247be974-a651-4b89-86ad-8c8e75562093 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:21.956147 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-73c16ece-34a0-4de8-84cc-dbd10f6421b3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:21.958989 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-247be974-a651-4b89-86ad-8c8e75562093 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.328159 Jul 20 15:34:21.962246 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 140/283] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:21 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:21.968049 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-73c16ece-34a0-4de8-84cc-dbd10f6421b3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:21.968506 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-73c16ece-34a0-4de8-84cc-dbd10f6421b3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:21.969280 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-73c16ece-34a0-4de8-84cc-dbd10f6421b3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:21.969712 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-73c16ece-34a0-4de8-84cc-dbd10f6421b3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:22.199329 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-73c16ece-34a0-4de8-84cc-dbd10f6421b3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:22.217920 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-73c16ece-34a0-4de8-84cc-dbd10f6421b3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1723 microversion: 2.1 time: 0.268540 Jul 20 15:34:22.220251 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 144/284] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:21 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:34:22.880454 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b03a9d21-9dcc-422a-be01-ae91d1223914 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:22.881117 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b03a9d21-9dcc-422a-be01-ae91d1223914 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:22.888258 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b03a9d21-9dcc-422a-be01-ae91d1223914 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:22.888949 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b03a9d21-9dcc-422a-be01-ae91d1223914 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:22.889710 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b03a9d21-9dcc-422a-be01-ae91d1223914 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:22.890139 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b03a9d21-9dcc-422a-be01-ae91d1223914 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:22.999153 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-41ce2803-908b-461b-86dc-fa0e49c6edfd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:23.001758 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-41ce2803-908b-461b-86dc-fa0e49c6edfd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:23.020282 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-41ce2803-908b-461b-86dc-fa0e49c6edfd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:23.021536 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-41ce2803-908b-461b-86dc-fa0e49c6edfd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:23.023234 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-41ce2803-908b-461b-86dc-fa0e49c6edfd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:23.024122 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-41ce2803-908b-461b-86dc-fa0e49c6edfd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:23.077281 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b03a9d21-9dcc-422a-be01-ae91d1223914 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:23.087379 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b03a9d21-9dcc-422a-be01-ae91d1223914 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1368 microversion: 2.1 time: 0.210983 Jul 20 15:34:23.108633 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 141/285] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:22 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1368 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:23.247973 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-88be3ba4-5eab-4eef-b0bf-3999f47a8ab3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:23.248679 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-88be3ba4-5eab-4eef-b0bf-3999f47a8ab3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:23.263589 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-88be3ba4-5eab-4eef-b0bf-3999f47a8ab3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:23.269883 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-88be3ba4-5eab-4eef-b0bf-3999f47a8ab3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:23.274375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-88be3ba4-5eab-4eef-b0bf-3999f47a8ab3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:23.275475 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-88be3ba4-5eab-4eef-b0bf-3999f47a8ab3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:23.288501 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-41ce2803-908b-461b-86dc-fa0e49c6edfd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:23.303087 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-41ce2803-908b-461b-86dc-fa0e49c6edfd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:23.306566 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-41ce2803-908b-461b-86dc-fa0e49c6edfd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:23.312489 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-41ce2803-908b-461b-86dc-fa0e49c6edfd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.318728 Jul 20 15:34:23.314349 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 145/286] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:22 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:23.560595 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-88be3ba4-5eab-4eef-b0bf-3999f47a8ab3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:23.570552 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-88be3ba4-5eab-4eef-b0bf-3999f47a8ab3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1723 microversion: 2.1 time: 0.327627 Jul 20 15:34:23.581924 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 142/287] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:23 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1723 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:34:24.116299 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-7559e90d-cb9d-47ee-b37e-99513e9c1985 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:24.116900 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-7559e90d-cb9d-47ee-b37e-99513e9c1985 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:24.124058 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7559e90d-cb9d-47ee-b37e-99513e9c1985 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:24.124508 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7559e90d-cb9d-47ee-b37e-99513e9c1985 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:24.125288 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7559e90d-cb9d-47ee-b37e-99513e9c1985 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:24.125745 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7559e90d-cb9d-47ee-b37e-99513e9c1985 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:24.283062 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-7559e90d-cb9d-47ee-b37e-99513e9c1985 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:24.290639 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-7559e90d-cb9d-47ee-b37e-99513e9c1985 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1368 microversion: 2.1 time: 0.178737 Jul 20 15:34:24.291218 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 146/288] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:24 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:24.340470 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b80f1083-8fad-4bf1-8e76-a7befa535dc5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:24.341772 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b80f1083-8fad-4bf1-8e76-a7befa535dc5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:24.348724 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b80f1083-8fad-4bf1-8e76-a7befa535dc5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:24.349493 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b80f1083-8fad-4bf1-8e76-a7befa535dc5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:24.350513 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b80f1083-8fad-4bf1-8e76-a7befa535dc5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:24.351150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b80f1083-8fad-4bf1-8e76-a7befa535dc5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:24.592585 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-6f47b07d-f656-4c18-8974-51ba99173358 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:24.598968 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-6f47b07d-f656-4c18-8974-51ba99173358 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:24.614532 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6f47b07d-f656-4c18-8974-51ba99173358 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:24.615632 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6f47b07d-f656-4c18-8974-51ba99173358 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:24.618565 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6f47b07d-f656-4c18-8974-51ba99173358 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:24.620380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6f47b07d-f656-4c18-8974-51ba99173358 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:24.818570 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b80f1083-8fad-4bf1-8e76-a7befa535dc5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:24.826480 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b80f1083-8fad-4bf1-8e76-a7befa535dc5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:24.828430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b80f1083-8fad-4bf1-8e76-a7befa535dc5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:24.830213 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b80f1083-8fad-4bf1-8e76-a7befa535dc5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.495173 Jul 20 15:34:24.843227 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 143/289] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:24 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:24.910112 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-6f47b07d-f656-4c18-8974-51ba99173358 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:24.926027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-6f47b07d-f656-4c18-8974-51ba99173358 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1700 microversion: 2.1 time: 0.337559 Jul 20 15:34:24.926598 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 147/290] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:24 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1700 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:24.949490 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-05b044f9-6f35-4261-abde-14981e62417d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:34:24.962227 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-05b044f9-6f35-4261-abde-14981e62417d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:24.970878 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-05b044f9-6f35-4261-abde-14981e62417d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:25.043346 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-05b044f9-6f35-4261-abde-14981e62417d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Going to try to start instance {{(pid=124712) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 15:34:25.309598 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5d0152b0-3b2e-4866-b07e-043e68020180 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:25.311575 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5d0152b0-3b2e-4866-b07e-043e68020180 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:25.323980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5d0152b0-3b2e-4866-b07e-043e68020180 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:25.324686 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5d0152b0-3b2e-4866-b07e-043e68020180 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:25.327448 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5d0152b0-3b2e-4866-b07e-043e68020180 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:25.327448 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5d0152b0-3b2e-4866-b07e-043e68020180 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:25.416918 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-05b044f9-6f35-4261-abde-14981e62417d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "POST /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a/action" status: 202 len: 0 microversion: 2.1 time: 0.471689 Jul 20 15:34:25.424893 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 144/291] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Jul 20 15:34:24 2022] POST /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:34:25.432592 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-cf2f4fa2-df29-441f-9cf1-b06cb021d4f6 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:25.434885 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-cf2f4fa2-df29-441f-9cf1-b06cb021d4f6 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:25.443817 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cf2f4fa2-df29-441f-9cf1-b06cb021d4f6 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:25.446693 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cf2f4fa2-df29-441f-9cf1-b06cb021d4f6 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:25.453071 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cf2f4fa2-df29-441f-9cf1-b06cb021d4f6 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:25.468702 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cf2f4fa2-df29-441f-9cf1-b06cb021d4f6 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:25.654738 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5d0152b0-3b2e-4866-b07e-043e68020180 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:25.731993 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5d0152b0-3b2e-4866-b07e-043e68020180 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1368 microversion: 2.1 time: 0.409689 Jul 20 15:34:25.742059 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 148/292] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:25 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1368 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:25.791485 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-be8d7428-1556-4f77-9b78-c65088a4344c req-2e4f47af-fde0-4ffc-b168-fbf21aba7f21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91beb453-6320-472a-951c-3fda16747994", "name": "network-vif-plugged", "status": "completed", "tag": "e2135397-d828-46e2-a219-f788f406eb08"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:34:25.814684 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-be8d7428-1556-4f77-9b78-c65088a4344c req-2e4f47af-fde0-4ffc-b168-fbf21aba7f21 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:25.820032 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-be8d7428-1556-4f77-9b78-c65088a4344c req-2e4f47af-fde0-4ffc-b168-fbf21aba7f21 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:25.847069 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-be8d7428-1556-4f77-9b78-c65088a4344c req-2e4f47af-fde0-4ffc-b168-fbf21aba7f21 service nova] Creating event network-vif-plugged:e2135397-d828-46e2-a219-f788f406eb08 for instance 91beb453-6320-472a-951c-3fda16747994 on hv-cinder-81914 Jul 20 15:34:25.857307 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-be8d7428-1556-4f77-9b78-c65088a4344c req-2e4f47af-fde0-4ffc-b168-fbf21aba7f21 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070580 Jul 20 15:34:25.859669 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 149/293] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:34:25.868966 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-b9377acb-be1e-40f5-8067-6fd7aad8c46d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:25.877408 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-b9377acb-be1e-40f5-8067-6fd7aad8c46d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:25.885324 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b9377acb-be1e-40f5-8067-6fd7aad8c46d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:25.886323 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b9377acb-be1e-40f5-8067-6fd7aad8c46d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:25.896436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b9377acb-be1e-40f5-8067-6fd7aad8c46d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:25.897969 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b9377acb-be1e-40f5-8067-6fd7aad8c46d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:26.079891 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-cf2f4fa2-df29-441f-9cf1-b06cb021d4f6 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:26.096920 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-cf2f4fa2-df29-441f-9cf1-b06cb021d4f6 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1709 microversion: 2.1 time: 0.669329 Jul 20 15:34:26.098867 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 145/294] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:25 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1709 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:26.206038 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-b9377acb-be1e-40f5-8067-6fd7aad8c46d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:26.216759 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-b9377acb-be1e-40f5-8067-6fd7aad8c46d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:26.220346 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-b9377acb-be1e-40f5-8067-6fd7aad8c46d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:26.221976 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-b9377acb-be1e-40f5-8067-6fd7aad8c46d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.360821 Jul 20 15:34:26.222926 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 150/295] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:25 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:26.749218 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-21fcd8ec-f98e-4c7e-b536-285f390bf61f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:26.749833 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-21fcd8ec-f98e-4c7e-b536-285f390bf61f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:26.757655 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-21fcd8ec-f98e-4c7e-b536-285f390bf61f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:26.758116 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-21fcd8ec-f98e-4c7e-b536-285f390bf61f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:26.758921 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-21fcd8ec-f98e-4c7e-b536-285f390bf61f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:26.759362 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-21fcd8ec-f98e-4c7e-b536-285f390bf61f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:26.800948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:27.120938 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-9945bc58-4ade-4469-9e5e-4c719a0dbb90 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:27.122958 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-9945bc58-4ade-4469-9e5e-4c719a0dbb90 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:27.134456 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9945bc58-4ade-4469-9e5e-4c719a0dbb90 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:27.134456 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9945bc58-4ade-4469-9e5e-4c719a0dbb90 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:27.134456 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9945bc58-4ade-4469-9e5e-4c719a0dbb90 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:27.134456 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9945bc58-4ade-4469-9e5e-4c719a0dbb90 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:27.334017 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-21fcd8ec-f98e-4c7e-b536-285f390bf61f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:27.348221 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-21fcd8ec-f98e-4c7e-b536-285f390bf61f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1368 microversion: 2.1 time: 0.600590 Jul 20 15:34:27.351103 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 146/296] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:26 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1368 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:27.359851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-86ebeaf8-7a3e-4084-a1c9-029a274b5430 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:27.360723 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-86ebeaf8-7a3e-4084-a1c9-029a274b5430 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:27.378738 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-86ebeaf8-7a3e-4084-a1c9-029a274b5430 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:27.378738 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-86ebeaf8-7a3e-4084-a1c9-029a274b5430 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:27.378738 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-86ebeaf8-7a3e-4084-a1c9-029a274b5430 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:27.378738 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-86ebeaf8-7a3e-4084-a1c9-029a274b5430 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:27.717420 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-9945bc58-4ade-4469-9e5e-4c719a0dbb90 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:27.731030 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-9945bc58-4ade-4469-9e5e-4c719a0dbb90 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1709 microversion: 2.1 time: 0.619994 Jul 20 15:34:27.741666 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 151/297] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:27 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1709 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:27.861304 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-86ebeaf8-7a3e-4084-a1c9-029a274b5430 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:27.880851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-86ebeaf8-7a3e-4084-a1c9-029a274b5430 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:27.884346 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-86ebeaf8-7a3e-4084-a1c9-029a274b5430 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:27.889204 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-86ebeaf8-7a3e-4084-a1c9-029a274b5430 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1743 microversion: 2.20 time: 0.536805 Jul 20 15:34:27.889780 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 147/298] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:27 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1743 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:28.370198 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-007f3fde-b6bc-4806-ab3c-06bec0576942 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:28.370919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-007f3fde-b6bc-4806-ab3c-06bec0576942 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:28.379475 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-007f3fde-b6bc-4806-ab3c-06bec0576942 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:28.380263 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-007f3fde-b6bc-4806-ab3c-06bec0576942 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:28.381268 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-007f3fde-b6bc-4806-ab3c-06bec0576942 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:28.381914 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-007f3fde-b6bc-4806-ab3c-06bec0576942 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:28.678803 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-007f3fde-b6bc-4806-ab3c-06bec0576942 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:28.693599 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-007f3fde-b6bc-4806-ab3c-06bec0576942 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1368 microversion: 2.1 time: 0.325935 Jul 20 15:34:28.695120 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 152/299] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:28 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1368 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:28.748907 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-146d2838-cfd9-4db1-8e43-2e24ecf20a68 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:28.750063 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-146d2838-cfd9-4db1-8e43-2e24ecf20a68 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:28.752541 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:28.756451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-146d2838-cfd9-4db1-8e43-2e24ecf20a68 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:28.756989 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-146d2838-cfd9-4db1-8e43-2e24ecf20a68 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:28.757682 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-146d2838-cfd9-4db1-8e43-2e24ecf20a68 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:28.758201 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-146d2838-cfd9-4db1-8e43-2e24ecf20a68 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:28.908071 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-a0e3ad6a-ba0e-43a3-9c61-1c751432c8f2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:28.909121 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-a0e3ad6a-ba0e-43a3-9c61-1c751432c8f2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:28.915273 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a0e3ad6a-ba0e-43a3-9c61-1c751432c8f2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:28.915956 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a0e3ad6a-ba0e-43a3-9c61-1c751432c8f2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:28.916632 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a0e3ad6a-ba0e-43a3-9c61-1c751432c8f2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:28.917098 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a0e3ad6a-ba0e-43a3-9c61-1c751432c8f2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:29.060242 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-146d2838-cfd9-4db1-8e43-2e24ecf20a68 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:29.071538 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-146d2838-cfd9-4db1-8e43-2e24ecf20a68 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1709 microversion: 2.1 time: 0.326100 Jul 20 15:34:29.073424 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 148/300] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:28 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1709 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:29.265736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-a0e3ad6a-ba0e-43a3-9c61-1c751432c8f2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:29.270176 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=100 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:29.280780 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-a0e3ad6a-ba0e-43a3-9c61-1c751432c8f2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:29.282514 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-a0e3ad6a-ba0e-43a3-9c61-1c751432c8f2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:29.291005 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-a0e3ad6a-ba0e-43a3-9c61-1c751432c8f2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1743 microversion: 2.20 time: 0.387616 Jul 20 15:34:29.307179 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 153/301] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:28 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1743 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:34:29.413460 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-8f7db979-660c-4216-aa68-5c9cc04518d0 req-164b48db-404a-4eb2-ac29-aba3d720839f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4cd0f35-70ba-409d-b217-32d5a9ab6cd6", "name": "network-vif-plugged", "status": "completed", "tag": "59e14bde-8d7e-43e1-8cdf-acd276b65784"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:34:29.437549 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-8f7db979-660c-4216-aa68-5c9cc04518d0 req-164b48db-404a-4eb2-ac29-aba3d720839f service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:29.443269 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-8f7db979-660c-4216-aa68-5c9cc04518d0 req-164b48db-404a-4eb2-ac29-aba3d720839f service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:29.469181 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-8f7db979-660c-4216-aa68-5c9cc04518d0 req-164b48db-404a-4eb2-ac29-aba3d720839f service nova] Creating event network-vif-plugged:59e14bde-8d7e-43e1-8cdf-acd276b65784 for instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 on hv-cinder-81914 Jul 20 15:34:29.479341 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-8f7db979-660c-4216-aa68-5c9cc04518d0 req-164b48db-404a-4eb2-ac29-aba3d720839f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069234 Jul 20 15:34:29.486092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 149/302] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:34:29.718308 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-470fc0b4-2157-4064-8c0b-e6448d9a4d41 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:29.719114 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-470fc0b4-2157-4064-8c0b-e6448d9a4d41 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:29.737526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-470fc0b4-2157-4064-8c0b-e6448d9a4d41 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:29.742434 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-470fc0b4-2157-4064-8c0b-e6448d9a4d41 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:29.742434 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-470fc0b4-2157-4064-8c0b-e6448d9a4d41 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:29.742434 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-470fc0b4-2157-4064-8c0b-e6448d9a4d41 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:30.094720 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b4f93bae-97c5-4349-9bb2-6036d065bde3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:30.096677 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b4f93bae-97c5-4349-9bb2-6036d065bde3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:30.110083 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-470fc0b4-2157-4064-8c0b-e6448d9a4d41 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:30.123822 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b4f93bae-97c5-4349-9bb2-6036d065bde3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:30.124273 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b4f93bae-97c5-4349-9bb2-6036d065bde3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:30.124838 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-470fc0b4-2157-4064-8c0b-e6448d9a4d41 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1561 microversion: 2.1 time: 0.411303 Jul 20 15:34:30.125050 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b4f93bae-97c5-4349-9bb2-6036d065bde3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:30.126509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 154/303] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:29 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1561 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:30.128722 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b4f93bae-97c5-4349-9bb2-6036d065bde3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:30.152163 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-2264f0dc-321c-436c-abb3-7c7be20d6971 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:30.153739 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-2264f0dc-321c-436c-abb3-7c7be20d6971 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:30.175062 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2264f0dc-321c-436c-abb3-7c7be20d6971 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:30.177748 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2264f0dc-321c-436c-abb3-7c7be20d6971 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:30.179645 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2264f0dc-321c-436c-abb3-7c7be20d6971 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:30.183264 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2264f0dc-321c-436c-abb3-7c7be20d6971 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:30.474025 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-2264f0dc-321c-436c-abb3-7c7be20d6971 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.333941 Jul 20 15:34:30.482166 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 155/304] 10.222.0.78 () {58 vars in 1274 bytes} [Wed Jul 20 15:34:30 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994/os-interface => generated 284 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:34:30.499191 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-038f0ed3-432e-471f-9f2e-7e579e46621a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:30.503876 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-038f0ed3-432e-471f-9f2e-7e579e46621a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:30.522868 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-038f0ed3-432e-471f-9f2e-7e579e46621a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:30.524849 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-038f0ed3-432e-471f-9f2e-7e579e46621a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:30.524849 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-038f0ed3-432e-471f-9f2e-7e579e46621a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:30.530021 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-038f0ed3-432e-471f-9f2e-7e579e46621a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:30.976057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b4f93bae-97c5-4349-9bb2-6036d065bde3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:30.988480 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b4f93bae-97c5-4349-9bb2-6036d065bde3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1713 microversion: 2.1 time: 0.899878 Jul 20 15:34:30.990372 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 150/305] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:30 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1713 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:31.456014 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-038f0ed3-432e-471f-9f2e-7e579e46621a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:31.470990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-038f0ed3-432e-471f-9f2e-7e579e46621a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:31.475320 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-038f0ed3-432e-471f-9f2e-7e579e46621a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:31.475320 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-038f0ed3-432e-471f-9f2e-7e579e46621a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1743 microversion: 2.20 time: 0.993433 Jul 20 15:34:31.488010 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 156/306] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:30 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1743 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:32.496495 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-0e4251b6-70e9-4eb0-8e89-9ab78e4f5d93 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:32.496495 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-0e4251b6-70e9-4eb0-8e89-9ab78e4f5d93 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:32.507787 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0e4251b6-70e9-4eb0-8e89-9ab78e4f5d93 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:32.510961 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0e4251b6-70e9-4eb0-8e89-9ab78e4f5d93 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:32.510961 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0e4251b6-70e9-4eb0-8e89-9ab78e4f5d93 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:32.512550 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0e4251b6-70e9-4eb0-8e89-9ab78e4f5d93 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:32.960900 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-0e4251b6-70e9-4eb0-8e89-9ab78e4f5d93 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:32.972496 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-0e4251b6-70e9-4eb0-8e89-9ab78e4f5d93 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:32.978694 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-0e4251b6-70e9-4eb0-8e89-9ab78e4f5d93 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:32.979952 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-0e4251b6-70e9-4eb0-8e89-9ab78e4f5d93 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1743 microversion: 2.20 time: 0.488219 Jul 20 15:34:32.980528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 151/307] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:32 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1743 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:33.729534 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-2af9a2e5-3a11-42d2-95d3-d36eab9ee342 req-0843f107-5ec7-4f46-9f33-f418d9b52ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91beb453-6320-472a-951c-3fda16747994", "tag": "e2135397-d828-46e2-a219-f788f406eb08"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:34:33.745043 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-2af9a2e5-3a11-42d2-95d3-d36eab9ee342 req-0843f107-5ec7-4f46-9f33-f418d9b52ed9 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:33.748451 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-2af9a2e5-3a11-42d2-95d3-d36eab9ee342 req-0843f107-5ec7-4f46-9f33-f418d9b52ed9 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:33.778890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-2af9a2e5-3a11-42d2-95d3-d36eab9ee342 req-0843f107-5ec7-4f46-9f33-f418d9b52ed9 service nova] Creating event network-changed:e2135397-d828-46e2-a219-f788f406eb08 for instance 91beb453-6320-472a-951c-3fda16747994 on hv-cinder-81914 Jul 20 15:34:33.786995 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-2af9a2e5-3a11-42d2-95d3-d36eab9ee342 req-0843f107-5ec7-4f46-9f33-f418d9b52ed9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061189 Jul 20 15:34:33.788222 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 157/308] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:34:34.000839 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-021ac382-5d0a-4f22-9224-43f0dedb327a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:34.003164 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-021ac382-5d0a-4f22-9224-43f0dedb327a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:34.031001 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-021ac382-5d0a-4f22-9224-43f0dedb327a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:34.031638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-021ac382-5d0a-4f22-9224-43f0dedb327a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:34.032476 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-021ac382-5d0a-4f22-9224-43f0dedb327a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:34.037960 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-021ac382-5d0a-4f22-9224-43f0dedb327a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:34.936011 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-021ac382-5d0a-4f22-9224-43f0dedb327a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:34.950783 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-021ac382-5d0a-4f22-9224-43f0dedb327a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:34.957754 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-021ac382-5d0a-4f22-9224-43f0dedb327a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:34.963153 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-021ac382-5d0a-4f22-9224-43f0dedb327a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1738 microversion: 2.20 time: 0.965990 Jul 20 15:34:34.965586 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 152/309] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:33 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1738 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:34:35.996282 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-26607673-3fa1-4b94-bd17-13a184b888ff tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:35.997621 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-26607673-3fa1-4b94-bd17-13a184b888ff tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:36.026221 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-26607673-3fa1-4b94-bd17-13a184b888ff tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:36.027745 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-26607673-3fa1-4b94-bd17-13a184b888ff tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:36.030052 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-26607673-3fa1-4b94-bd17-13a184b888ff tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:36.030713 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-26607673-3fa1-4b94-bd17-13a184b888ff tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:36.691986 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-26607673-3fa1-4b94-bd17-13a184b888ff tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:36.717187 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-26607673-3fa1-4b94-bd17-13a184b888ff tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:36.718860 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-26607673-3fa1-4b94-bd17-13a184b888ff tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:36.725941 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-26607673-3fa1-4b94-bd17-13a184b888ff tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1738 microversion: 2.20 time: 0.740121 Jul 20 15:34:36.738818 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 158/310] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:35 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1738 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:37.752923 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b6ac7916-64c5-4b21-bf4b-6b57ea8c8eab tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:37.755699 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b6ac7916-64c5-4b21-bf4b-6b57ea8c8eab tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:37.764647 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b6ac7916-64c5-4b21-bf4b-6b57ea8c8eab tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:37.765590 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b6ac7916-64c5-4b21-bf4b-6b57ea8c8eab tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:37.766933 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b6ac7916-64c5-4b21-bf4b-6b57ea8c8eab tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:37.767651 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b6ac7916-64c5-4b21-bf4b-6b57ea8c8eab tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:38.196167 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b6ac7916-64c5-4b21-bf4b-6b57ea8c8eab tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:38.220056 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b6ac7916-64c5-4b21-bf4b-6b57ea8c8eab tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:38.238024 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b6ac7916-64c5-4b21-bf4b-6b57ea8c8eab tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:38.239631 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b6ac7916-64c5-4b21-bf4b-6b57ea8c8eab tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1738 microversion: 2.20 time: 0.495696 Jul 20 15:34:38.266400 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 153/311] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:37 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1738 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:34:39.280327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-921c22b9-b04c-470b-aa5b-d3482fafd771 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:39.281873 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-921c22b9-b04c-470b-aa5b-d3482fafd771 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:39.315051 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-921c22b9-b04c-470b-aa5b-d3482fafd771 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:39.322571 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-921c22b9-b04c-470b-aa5b-d3482fafd771 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:39.327234 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-921c22b9-b04c-470b-aa5b-d3482fafd771 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:39.329836 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-921c22b9-b04c-470b-aa5b-d3482fafd771 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:39.757724 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-921c22b9-b04c-470b-aa5b-d3482fafd771 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:39.777913 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-921c22b9-b04c-470b-aa5b-d3482fafd771 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:39.780337 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-921c22b9-b04c-470b-aa5b-d3482fafd771 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:39.786659 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-921c22b9-b04c-470b-aa5b-d3482fafd771 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1738 microversion: 2.20 time: 0.510681 Jul 20 15:34:39.790560 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 159/312] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:39 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1738 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:40.811220 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e7240bec-5c45-402b-a7e2-14ba0780e9b9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:40.814642 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e7240bec-5c45-402b-a7e2-14ba0780e9b9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:40.830408 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e7240bec-5c45-402b-a7e2-14ba0780e9b9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:40.839925 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e7240bec-5c45-402b-a7e2-14ba0780e9b9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:40.842684 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e7240bec-5c45-402b-a7e2-14ba0780e9b9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:40.844854 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e7240bec-5c45-402b-a7e2-14ba0780e9b9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:41.282814 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-e7240bec-5c45-402b-a7e2-14ba0780e9b9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:41.293153 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-e7240bec-5c45-402b-a7e2-14ba0780e9b9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:41.299165 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-e7240bec-5c45-402b-a7e2-14ba0780e9b9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:41.307129 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-e7240bec-5c45-402b-a7e2-14ba0780e9b9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1738 microversion: 2.20 time: 0.497807 Jul 20 15:34:41.319857 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 154/313] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:40 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1738 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:42.326901 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-3ecc8fe3-dfdc-418e-913d-2ad3e7559d8c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:42.327504 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-3ecc8fe3-dfdc-418e-913d-2ad3e7559d8c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:42.342395 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3ecc8fe3-dfdc-418e-913d-2ad3e7559d8c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:42.342846 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3ecc8fe3-dfdc-418e-913d-2ad3e7559d8c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:42.343639 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3ecc8fe3-dfdc-418e-913d-2ad3e7559d8c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:42.344076 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3ecc8fe3-dfdc-418e-913d-2ad3e7559d8c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:42.844190 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-3ecc8fe3-dfdc-418e-913d-2ad3e7559d8c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:42.853258 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-3ecc8fe3-dfdc-418e-913d-2ad3e7559d8c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:42.856931 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-3ecc8fe3-dfdc-418e-913d-2ad3e7559d8c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:42.858117 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-3ecc8fe3-dfdc-418e-913d-2ad3e7559d8c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1738 microversion: 2.20 time: 0.535330 Jul 20 15:34:42.875411 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 160/314] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:42 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1738 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:43.891497 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-cd6189eb-d18c-4e01-95c4-ba0944a7a99c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:43.893068 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-cd6189eb-d18c-4e01-95c4-ba0944a7a99c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:43.911416 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cd6189eb-d18c-4e01-95c4-ba0944a7a99c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:43.913937 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cd6189eb-d18c-4e01-95c4-ba0944a7a99c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:43.915478 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cd6189eb-d18c-4e01-95c4-ba0944a7a99c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:43.924061 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cd6189eb-d18c-4e01-95c4-ba0944a7a99c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:44.277154 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-cd6189eb-d18c-4e01-95c4-ba0944a7a99c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:44.299446 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-cd6189eb-d18c-4e01-95c4-ba0944a7a99c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:44.306362 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-cd6189eb-d18c-4e01-95c4-ba0944a7a99c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:44.308016 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-cd6189eb-d18c-4e01-95c4-ba0944a7a99c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1738 microversion: 2.20 time: 0.422933 Jul 20 15:34:44.310875 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 155/315] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:43 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1738 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:45.377388 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c5476e32-a868-4be4-b102-0f00138d1868 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:45.379097 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c5476e32-a868-4be4-b102-0f00138d1868 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:45.392565 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c5476e32-a868-4be4-b102-0f00138d1868 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:45.396037 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c5476e32-a868-4be4-b102-0f00138d1868 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:45.402454 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c5476e32-a868-4be4-b102-0f00138d1868 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:45.403285 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c5476e32-a868-4be4-b102-0f00138d1868 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:45.632025 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c5476e32-a868-4be4-b102-0f00138d1868 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:45.640939 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c5476e32-a868-4be4-b102-0f00138d1868 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:45.642874 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c5476e32-a868-4be4-b102-0f00138d1868 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:45.644715 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c5476e32-a868-4be4-b102-0f00138d1868 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1738 microversion: 2.20 time: 0.272984 Jul 20 15:34:45.645548 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 161/316] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:45 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1738 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:46.664201 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-f1da9ead-ae1b-46c1-ab93-4183b1aaab20 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:46.664821 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-f1da9ead-ae1b-46c1-ab93-4183b1aaab20 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:46.678691 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f1da9ead-ae1b-46c1-ab93-4183b1aaab20 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:46.684872 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f1da9ead-ae1b-46c1-ab93-4183b1aaab20 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:46.684872 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f1da9ead-ae1b-46c1-ab93-4183b1aaab20 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:46.684872 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f1da9ead-ae1b-46c1-ab93-4183b1aaab20 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:46.852664 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-f1da9ead-ae1b-46c1-ab93-4183b1aaab20 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:46.882007 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-f1da9ead-ae1b-46c1-ab93-4183b1aaab20 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:46.885966 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-f1da9ead-ae1b-46c1-ab93-4183b1aaab20 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:46.887228 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-f1da9ead-ae1b-46c1-ab93-4183b1aaab20 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1738 microversion: 2.20 time: 0.226395 Jul 20 15:34:46.901192 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 156/317] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:46 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:47.908596 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-dadbb8b4-19ad-4949-8db5-4517e8932474 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:47.909267 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-dadbb8b4-19ad-4949-8db5-4517e8932474 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:47.922351 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dadbb8b4-19ad-4949-8db5-4517e8932474 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:47.922809 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dadbb8b4-19ad-4949-8db5-4517e8932474 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:47.923598 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dadbb8b4-19ad-4949-8db5-4517e8932474 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:47.924037 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dadbb8b4-19ad-4949-8db5-4517e8932474 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:48.251738 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-dadbb8b4-19ad-4949-8db5-4517e8932474 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:48.269163 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-dadbb8b4-19ad-4949-8db5-4517e8932474 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:48.270715 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-dadbb8b4-19ad-4949-8db5-4517e8932474 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:48.271898 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-dadbb8b4-19ad-4949-8db5-4517e8932474 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1738 microversion: 2.20 time: 0.367169 Jul 20 15:34:48.272463 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 162/318] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:47 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1738 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:34:49.344638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-2b1468f8-69d6-41f5-95a4-e8fe163c6923 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:49.345352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-2b1468f8-69d6-41f5-95a4-e8fe163c6923 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:49.370444 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2b1468f8-69d6-41f5-95a4-e8fe163c6923 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:49.372773 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2b1468f8-69d6-41f5-95a4-e8fe163c6923 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:49.378919 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2b1468f8-69d6-41f5-95a4-e8fe163c6923 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:49.381063 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2b1468f8-69d6-41f5-95a4-e8fe163c6923 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:49.789792 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-2b1468f8-69d6-41f5-95a4-e8fe163c6923 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:49.805779 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-2b1468f8-69d6-41f5-95a4-e8fe163c6923 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:49.807827 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-2b1468f8-69d6-41f5-95a4-e8fe163c6923 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:49.809719 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-2b1468f8-69d6-41f5-95a4-e8fe163c6923 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1738 microversion: 2.20 time: 0.515745 Jul 20 15:34:49.825060 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 157/319] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:49 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1738 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:50.830643 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-19ac27b9-461e-49bd-b91e-056a6bce06af tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:50.831664 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-19ac27b9-461e-49bd-b91e-056a6bce06af tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:50.833806 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=48 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:50.839401 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-19ac27b9-461e-49bd-b91e-056a6bce06af tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:50.839907 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-19ac27b9-461e-49bd-b91e-056a6bce06af tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:50.841321 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-19ac27b9-461e-49bd-b91e-056a6bce06af tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:50.841755 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-19ac27b9-461e-49bd-b91e-056a6bce06af tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:51.109241 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-19ac27b9-461e-49bd-b91e-056a6bce06af tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:51.119285 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-19ac27b9-461e-49bd-b91e-056a6bce06af tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:51.121460 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-19ac27b9-461e-49bd-b91e-056a6bce06af tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:51.123208 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-19ac27b9-461e-49bd-b91e-056a6bce06af tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1738 microversion: 2.20 time: 0.297369 Jul 20 15:34:51.138989 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 163/320] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:50 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1738 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:52.142499 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-dc7d67ed-a15e-4993-b8ef-aa9c70256528 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:52.143897 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-dc7d67ed-a15e-4993-b8ef-aa9c70256528 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:52.151107 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dc7d67ed-a15e-4993-b8ef-aa9c70256528 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:52.151889 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dc7d67ed-a15e-4993-b8ef-aa9c70256528 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:52.152956 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dc7d67ed-a15e-4993-b8ef-aa9c70256528 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:52.153619 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dc7d67ed-a15e-4993-b8ef-aa9c70256528 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:52.344095 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-dc7d67ed-a15e-4993-b8ef-aa9c70256528 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:52.355237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-dc7d67ed-a15e-4993-b8ef-aa9c70256528 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:52.359643 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-dc7d67ed-a15e-4993-b8ef-aa9c70256528 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:52.361288 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-dc7d67ed-a15e-4993-b8ef-aa9c70256528 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1738 microversion: 2.20 time: 0.224140 Jul 20 15:34:52.371164 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 158/321] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:52 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:53.385456 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c0258f9a-2c61-482a-b4cd-6c47d089c971 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:53.387000 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c0258f9a-2c61-482a-b4cd-6c47d089c971 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:53.399031 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c0258f9a-2c61-482a-b4cd-6c47d089c971 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:53.400412 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c0258f9a-2c61-482a-b4cd-6c47d089c971 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:53.401829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c0258f9a-2c61-482a-b4cd-6c47d089c971 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:53.402816 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c0258f9a-2c61-482a-b4cd-6c47d089c971 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:53.655067 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c0258f9a-2c61-482a-b4cd-6c47d089c971 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:53.664331 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c0258f9a-2c61-482a-b4cd-6c47d089c971 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:53.666945 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c0258f9a-2c61-482a-b4cd-6c47d089c971 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:53.669126 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c0258f9a-2c61-482a-b4cd-6c47d089c971 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1738 microversion: 2.20 time: 0.289304 Jul 20 15:34:53.675703 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 164/322] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:53 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1738 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:54.688174 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-9d8d5c71-43ef-4f89-a047-5b23f2672ba5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:54.694061 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-9d8d5c71-43ef-4f89-a047-5b23f2672ba5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:54.695140 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9d8d5c71-43ef-4f89-a047-5b23f2672ba5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:54.695589 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9d8d5c71-43ef-4f89-a047-5b23f2672ba5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:54.696344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9d8d5c71-43ef-4f89-a047-5b23f2672ba5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:54.696781 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9d8d5c71-43ef-4f89-a047-5b23f2672ba5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:54.845980 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-9d8d5c71-43ef-4f89-a047-5b23f2672ba5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:54.866648 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-9d8d5c71-43ef-4f89-a047-5b23f2672ba5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:54.869287 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-9d8d5c71-43ef-4f89-a047-5b23f2672ba5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:54.870557 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-9d8d5c71-43ef-4f89-a047-5b23f2672ba5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1738 microversion: 2.20 time: 0.186796 Jul 20 15:34:54.871126 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 159/323] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:54 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:55.845151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d44a1d8f-7e3d-470a-a306-d7284b160e4b tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Action: 'create', calling method: .version_select at 0x7efd90ce8dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1683463991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDA6yIocRD3UTF0L+CPKfG9OB6LO03+X0daf7fI+Jy6bEdMuJWidwYA0+K7IG7NqXjbdINxIQZny8lKZ+PS5J/Ty2NaH5oqcOBeho5iafQ+m75oHVxSIZuviYLzqq6hHkg=="}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:34:55.860936 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-d44a1d8f-7e3d-470a-a306-d7284b160e4b tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Getting quotas for project 8793a880033e400d89ac8de5a30003b7. Resources: {'key_pairs'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:34:55.864907 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-d44a1d8f-7e3d-470a-a306-d7284b160e4b tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Getting quotas for user dce92cce74c84abcbec76358c860535f and project 8793a880033e400d89ac8de5a30003b7. Resources: {'key_pairs'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:34:55.876978 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d44a1d8f-7e3d-470a-a306-d7284b160e4b tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [76ee1150-3288-4830-9b93-570eaf82d978] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 15:34:55.890217 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d1db8b3d-df58-47be-aa79-fdbc7aa391c7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:55.890880 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d1db8b3d-df58-47be-aa79-fdbc7aa391c7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:55.897469 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d1db8b3d-df58-47be-aa79-fdbc7aa391c7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:55.899561 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d1db8b3d-df58-47be-aa79-fdbc7aa391c7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:55.899561 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d1db8b3d-df58-47be-aa79-fdbc7aa391c7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:55.900477 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d1db8b3d-df58-47be-aa79-fdbc7aa391c7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:56.043051 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d1db8b3d-df58-47be-aa79-fdbc7aa391c7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:56.058430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d1db8b3d-df58-47be-aa79-fdbc7aa391c7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:56.060749 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d1db8b3d-df58-47be-aa79-fdbc7aa391c7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:56.062526 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-d1db8b3d-df58-47be-aa79-fdbc7aa391c7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1720 microversion: 2.20 time: 0.176880 Jul 20 15:34:56.068645 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 160/324] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:55 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:34:56.885840 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO oslo.messaging._drivers.impl_rabbit [None req-d44a1d8f-7e3d-470a-a306-d7284b160e4b tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [76ee1150-3288-4830-9b93-570eaf82d978] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 33478. Jul 20 15:34:57.000000 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d44a1d8f-7e3d-470a-a306-d7284b160e4b tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.158167 Jul 20 15:34:57.000893 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 165/325] 10.222.0.78 () {60 vars in 1158 bytes} [Wed Jul 20 15:34:55 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:34:57.085400 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-53b0000f-6608-4545-be5f-65c0096a868f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:57.086611 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-53b0000f-6608-4545-be5f-65c0096a868f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:57.105831 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-53b0000f-6608-4545-be5f-65c0096a868f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:57.107329 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-53b0000f-6608-4545-be5f-65c0096a868f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:57.108954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-53b0000f-6608-4545-be5f-65c0096a868f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:57.109693 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-53b0000f-6608-4545-be5f-65c0096a868f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:57.182506 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-f2f771f8-1b2c-4d00-abbd-8f3cdce28eb5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-148144616", "imageRef": "ae07f68b-064a-412d-97cf-61d68af4b021", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1683463991", "networks": [{"uuid": "04fc2edc-754b-4f43-aeb0-2e6d32720d77"}]}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:34:57.245170 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.network.neutron [None req-f2f771f8-1b2c-4d00-abbd-8f3cdce28eb5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] validate_networks() for [('04fc2edc-754b-4f43-aeb0-2e6d32720d77', None, None, None, None, None)] {{(pid=124711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 15:34:57.439001 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-53b0000f-6608-4545-be5f-65c0096a868f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:57.454131 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-53b0000f-6608-4545-be5f-65c0096a868f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:57.456136 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-53b0000f-6608-4545-be5f-65c0096a868f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:57.471269 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-53b0000f-6608-4545-be5f-65c0096a868f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1720 microversion: 2.20 time: 0.380354 Jul 20 15:34:57.471519 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 161/326] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:57 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1720 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:57.811666 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-f2f771f8-1b2c-4d00-abbd-8f3cdce28eb5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Flavor limits 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 15:34:57.812139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-f2f771f8-1b2c-4d00-abbd-8f3cdce28eb5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Image limits 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 15:34:57.812608 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-f2f771f8-1b2c-4d00-abbd-8f3cdce28eb5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Flavor pref 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 15:34:57.813016 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-f2f771f8-1b2c-4d00-abbd-8f3cdce28eb5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Image pref 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 15:34:57.813456 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-f2f771f8-1b2c-4d00-abbd-8f3cdce28eb5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 15:34:57.851785 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f2f771f8-1b2c-4d00-abbd-8f3cdce28eb5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:57.852840 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f2f771f8-1b2c-4d00-abbd-8f3cdce28eb5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:57.854385 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f2f771f8-1b2c-4d00-abbd-8f3cdce28eb5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:57.854892 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f2f771f8-1b2c-4d00-abbd-8f3cdce28eb5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:57.875352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-f2f771f8-1b2c-4d00-abbd-8f3cdce28eb5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Getting quotas for project 8793a880033e400d89ac8de5a30003b7. Resources: {'instances', 'ram', 'cores'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:34:57.879959 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-f2f771f8-1b2c-4d00-abbd-8f3cdce28eb5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Getting quotas for user dce92cce74c84abcbec76358c860535f and project 8793a880033e400d89ac8de5a30003b7. Resources: {'instances', 'ram', 'cores'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:34:57.896815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-f2f771f8-1b2c-4d00-abbd-8f3cdce28eb5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Going to run 1 instances... {{(pid=124711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 15:34:57.900377 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-f2f771f8-1b2c-4d00-abbd-8f3cdce28eb5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ae07f68b-064a-412d-97cf-61d68af4b021',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 15:34:58.070976 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-f2f771f8-1b2c-4d00-abbd-8f3cdce28eb5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.892738 Jul 20 15:34:58.072604 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 166/327] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Jul 20 15:34:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 15:34:58.087837 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-151c7771-6615-4323-830e-d613237e21bf tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:58.089520 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-151c7771-6615-4323-830e-d613237e21bf tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:58.192539 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-151c7771-6615-4323-830e-d613237e21bf tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:58.196836 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-ee4bb666-824f-45c3-8981-67a914d17444 req-9e237511-b508-4d3f-98bd-d2ff0c516112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4cd0f35-70ba-409d-b217-32d5a9ab6cd6", "name": "network-vif-unplugged", "status": "completed", "tag": "59e14bde-8d7e-43e1-8cdf-acd276b65784"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:34:58.210908 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-151c7771-6615-4323-830e-d613237e21bf tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1258 microversion: 2.1 time: 0.131268 Jul 20 15:34:58.212800 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 162/328] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:58 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1258 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:58.215363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-ee4bb666-824f-45c3-8981-67a914d17444 req-9e237511-b508-4d3f-98bd-d2ff0c516112 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:58.216686 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-ee4bb666-824f-45c3-8981-67a914d17444 req-9e237511-b508-4d3f-98bd-d2ff0c516112 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:58.241473 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-ee4bb666-824f-45c3-8981-67a914d17444 req-9e237511-b508-4d3f-98bd-d2ff0c516112 service nova] Creating event network-vif-unplugged:59e14bde-8d7e-43e1-8cdf-acd276b65784 for instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 on hv-cinder-81914 Jul 20 15:34:58.249479 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-ee4bb666-824f-45c3-8981-67a914d17444 req-9e237511-b508-4d3f-98bd-d2ff0c516112 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061152 Jul 20 15:34:58.251065 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 167/329] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:34:58.489754 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-fcc147a8-f77f-476b-acf7-1b61f58b5096 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:58.490396 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-fcc147a8-f77f-476b-acf7-1b61f58b5096 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:58.496948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fcc147a8-f77f-476b-acf7-1b61f58b5096 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:58.497399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fcc147a8-f77f-476b-acf7-1b61f58b5096 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:58.498222 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fcc147a8-f77f-476b-acf7-1b61f58b5096 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:58.498701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fcc147a8-f77f-476b-acf7-1b61f58b5096 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:58.673848 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-fcc147a8-f77f-476b-acf7-1b61f58b5096 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:58.683228 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-fcc147a8-f77f-476b-acf7-1b61f58b5096 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:58.684795 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-fcc147a8-f77f-476b-acf7-1b61f58b5096 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:58.686866 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-fcc147a8-f77f-476b-acf7-1b61f58b5096 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1720 microversion: 2.20 time: 0.201390 Jul 20 15:34:58.687882 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 163/330] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:58 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1720 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:34:59.233080 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-41ddf774-f51b-4c85-b807-730f030a77f6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:59.233812 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-41ddf774-f51b-4c85-b807-730f030a77f6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:59.307165 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-41ddf774-f51b-4c85-b807-730f030a77f6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:59.316607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-41ddf774-f51b-4c85-b807-730f030a77f6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1258 microversion: 2.1 time: 0.089033 Jul 20 15:34:59.316607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 168/331] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:34:59 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1258 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:34:59.709085 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-bf762e8a-8320-4de6-ba1f-7e0412987fb7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:34:59.709743 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-bf762e8a-8320-4de6-ba1f-7e0412987fb7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:34:59.716906 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bf762e8a-8320-4de6-ba1f-7e0412987fb7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:59.717356 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bf762e8a-8320-4de6-ba1f-7e0412987fb7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:59.718168 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bf762e8a-8320-4de6-ba1f-7e0412987fb7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:34:59.718640 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bf762e8a-8320-4de6-ba1f-7e0412987fb7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:34:59.852540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-bf762e8a-8320-4de6-ba1f-7e0412987fb7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:59.854850 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=100 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:34:59.861572 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-bf762e8a-8320-4de6-ba1f-7e0412987fb7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:59.863112 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-bf762e8a-8320-4de6-ba1f-7e0412987fb7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:34:59.864255 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-bf762e8a-8320-4de6-ba1f-7e0412987fb7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1720 microversion: 2.20 time: 0.159194 Jul 20 15:34:59.864810 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 164/332] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:34:59 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:00.332114 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-2a0d7b90-f070-47b3-b3d6-8c4e9fd69179 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:00.333019 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-2a0d7b90-f070-47b3-b3d6-8c4e9fd69179 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:00.390361 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2a0d7b90-f070-47b3-b3d6-8c4e9fd69179 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:00.399617 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-2a0d7b90-f070-47b3-b3d6-8c4e9fd69179 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1258 microversion: 2.1 time: 0.071329 Jul 20 15:35:00.409469 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 169/333] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:00 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1258 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:00.883397 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-232ec428-64bc-4a2a-944e-81a9f8a1798b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:00.884007 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-232ec428-64bc-4a2a-944e-81a9f8a1798b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:00.891087 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-232ec428-64bc-4a2a-944e-81a9f8a1798b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:00.891529 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-232ec428-64bc-4a2a-944e-81a9f8a1798b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:00.892307 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-232ec428-64bc-4a2a-944e-81a9f8a1798b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:00.892734 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-232ec428-64bc-4a2a-944e-81a9f8a1798b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:01.091672 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-232ec428-64bc-4a2a-944e-81a9f8a1798b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:01.107591 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-232ec428-64bc-4a2a-944e-81a9f8a1798b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:01.107591 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-232ec428-64bc-4a2a-944e-81a9f8a1798b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:01.110078 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-232ec428-64bc-4a2a-944e-81a9f8a1798b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1723 microversion: 2.20 time: 0.230096 Jul 20 15:35:01.110754 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 165/334] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:00 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:01.130282 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e2feab66-ea9a-4d4e-a2e0-62b3c5845446 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d6996f4-618c-4372-9955-de43a3b8717f"}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:35:01.131502 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e2feab66-ea9a-4d4e-a2e0-62b3c5845446 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:01.138831 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e2feab66-ea9a-4d4e-a2e0-62b3c5845446 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:01.139577 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e2feab66-ea9a-4d4e-a2e0-62b3c5845446 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:01.140378 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e2feab66-ea9a-4d4e-a2e0-62b3c5845446 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:01.140995 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e2feab66-ea9a-4d4e-a2e0-62b3c5845446 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:01.144120 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=65 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:01.416872 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-0fd835e2-c47a-4e1b-b1e6-b7f576a5c2a2 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:01.417714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-0fd835e2-c47a-4e1b-b1e6-b7f576a5c2a2 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:01.691102 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-0fd835e2-c47a-4e1b-b1e6-b7f576a5c2a2 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:01.697821 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-0fd835e2-c47a-4e1b-b1e6-b7f576a5c2a2 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1258 microversion: 2.1 time: 0.284755 Jul 20 15:35:01.698418 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 166/335] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:01 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1258 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:35:02.534837 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e2feab66-ea9a-4d4e-a2e0-62b3c5845446 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "POST /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.409499 Jul 20 15:35:02.536047 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 170/336] 10.222.0.78 () {62 vars in 1363 bytes} [Wed Jul 20 15:35:01 2022] POST /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/os-volume_attachments => generated 188 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 15:35:02.665813 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-295a4d96-3701-4c91-a203-d5f27b0fe59a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:35:02.666619 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-295a4d96-3701-4c91-a203-d5f27b0fe59a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:02.669713 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=42 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:02.675794 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-295a4d96-3701-4c91-a203-d5f27b0fe59a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:02.675981 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-295a4d96-3701-4c91-a203-d5f27b0fe59a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:02.676745 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-295a4d96-3701-4c91-a203-d5f27b0fe59a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:02.677216 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-295a4d96-3701-4c91-a203-d5f27b0fe59a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:02.715660 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d921bb1d-9ac8-40eb-9e8f-790fff5a9da1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:02.716474 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-d921bb1d-9ac8-40eb-9e8f-790fff5a9da1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:02.722975 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d921bb1d-9ac8-40eb-9e8f-790fff5a9da1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:02.723414 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d921bb1d-9ac8-40eb-9e8f-790fff5a9da1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:02.724343 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d921bb1d-9ac8-40eb-9e8f-790fff5a9da1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:02.724772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d921bb1d-9ac8-40eb-9e8f-790fff5a9da1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:02.795525 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d921bb1d-9ac8-40eb-9e8f-790fff5a9da1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:02.803871 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d921bb1d-9ac8-40eb-9e8f-790fff5a9da1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1262 microversion: 2.1 time: 0.091986 Jul 20 15:35:02.803871 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 171/337] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:02 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1262 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:35:03.016664 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-295a4d96-3701-4c91-a203-d5f27b0fe59a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "POST /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/action" status: 202 len: 0 microversion: 2.20 time: 0.354862 Jul 20 15:35:03.023741 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 167/338] 10.222.0.78 () {62 vars in 1318 bytes} [Wed Jul 20 15:35:02 2022] POST /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 15:35:03.025784 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-186d5759-ebc8-4ac2-808d-844f5b8f5e79 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:03.026485 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-186d5759-ebc8-4ac2-808d-844f5b8f5e79 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:03.032948 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-186d5759-ebc8-4ac2-808d-844f5b8f5e79 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:03.033388 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-186d5759-ebc8-4ac2-808d-844f5b8f5e79 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:03.034145 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-186d5759-ebc8-4ac2-808d-844f5b8f5e79 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:03.034603 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-186d5759-ebc8-4ac2-808d-844f5b8f5e79 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:03.172863 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-186d5759-ebc8-4ac2-808d-844f5b8f5e79 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:03.185061 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-186d5759-ebc8-4ac2-808d-844f5b8f5e79 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:03.187290 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-186d5759-ebc8-4ac2-808d-844f5b8f5e79 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:03.188799 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-186d5759-ebc8-4ac2-808d-844f5b8f5e79 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1749 microversion: 2.20 time: 0.167273 Jul 20 15:35:03.189594 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 172/339] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:03 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1749 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:03.825992 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b7578ba3-f91b-488b-9123-5df1884b3be4 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:03.826643 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b7578ba3-f91b-488b-9123-5df1884b3be4 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:03.833997 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b7578ba3-f91b-488b-9123-5df1884b3be4 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:03.835423 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b7578ba3-f91b-488b-9123-5df1884b3be4 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:03.835423 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b7578ba3-f91b-488b-9123-5df1884b3be4 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:03.835656 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b7578ba3-f91b-488b-9123-5df1884b3be4 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:03.917726 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b7578ba3-f91b-488b-9123-5df1884b3be4 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:03.926004 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b7578ba3-f91b-488b-9123-5df1884b3be4 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1262 microversion: 2.1 time: 0.109180 Jul 20 15:35:03.930482 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 168/340] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:03 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1262 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:04.209242 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-0756c649-4f89-4846-9b5a-4ec8d26fce71 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:04.210685 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-0756c649-4f89-4846-9b5a-4ec8d26fce71 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:04.219222 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0756c649-4f89-4846-9b5a-4ec8d26fce71 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:04.220102 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0756c649-4f89-4846-9b5a-4ec8d26fce71 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:04.221326 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0756c649-4f89-4846-9b5a-4ec8d26fce71 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:04.222044 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0756c649-4f89-4846-9b5a-4ec8d26fce71 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:04.368965 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-0756c649-4f89-4846-9b5a-4ec8d26fce71 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:04.378366 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-0756c649-4f89-4846-9b5a-4ec8d26fce71 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:04.379877 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-0756c649-4f89-4846-9b5a-4ec8d26fce71 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:04.381042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-0756c649-4f89-4846-9b5a-4ec8d26fce71 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1749 microversion: 2.20 time: 0.176942 Jul 20 15:35:04.381599 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 173/341] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:04 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1749 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:04.944176 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-6eff8ad6-0cae-4671-97e6-08297b3aee8a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:04.945206 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-6eff8ad6-0cae-4671-97e6-08297b3aee8a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:04.962666 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6eff8ad6-0cae-4671-97e6-08297b3aee8a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:04.963245 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6eff8ad6-0cae-4671-97e6-08297b3aee8a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:04.964212 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6eff8ad6-0cae-4671-97e6-08297b3aee8a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:04.964684 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6eff8ad6-0cae-4671-97e6-08297b3aee8a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:05.028528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-6eff8ad6-0cae-4671-97e6-08297b3aee8a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:05.036091 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-6eff8ad6-0cae-4671-97e6-08297b3aee8a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1310 microversion: 2.1 time: 0.096176 Jul 20 15:35:05.036659 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 169/342] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:04 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1310 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:05.402206 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-be1126ec-8033-487f-982f-3c5f09567d8b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:05.404088 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-be1126ec-8033-487f-982f-3c5f09567d8b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:05.412942 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-be1126ec-8033-487f-982f-3c5f09567d8b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:05.413636 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-be1126ec-8033-487f-982f-3c5f09567d8b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:05.414619 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-be1126ec-8033-487f-982f-3c5f09567d8b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:05.415264 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-be1126ec-8033-487f-982f-3c5f09567d8b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:05.601201 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-be1126ec-8033-487f-982f-3c5f09567d8b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:05.612166 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-be1126ec-8033-487f-982f-3c5f09567d8b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:05.613924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-be1126ec-8033-487f-982f-3c5f09567d8b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:05.616587 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-be1126ec-8033-487f-982f-3c5f09567d8b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1751 microversion: 2.20 time: 0.219106 Jul 20 15:35:05.626539 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 174/343] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:05 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1751 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:06.054851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-9543a349-564b-4df9-8135-de12ffbf9d86 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:06.060729 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-9543a349-564b-4df9-8135-de12ffbf9d86 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:06.063816 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9543a349-564b-4df9-8135-de12ffbf9d86 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:06.064274 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9543a349-564b-4df9-8135-de12ffbf9d86 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:06.065079 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9543a349-564b-4df9-8135-de12ffbf9d86 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:06.065514 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9543a349-564b-4df9-8135-de12ffbf9d86 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:06.263679 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-9543a349-564b-4df9-8135-de12ffbf9d86 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:06.271823 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-9543a349-564b-4df9-8135-de12ffbf9d86 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1358 microversion: 2.1 time: 0.221873 Jul 20 15:35:06.283072 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 170/344] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:06 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:06.634576 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-2089ec6f-08e0-4c80-bb3b-2e7d3a9e9de7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:06.635165 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-2089ec6f-08e0-4c80-bb3b-2e7d3a9e9de7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:06.641707 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2089ec6f-08e0-4c80-bb3b-2e7d3a9e9de7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:06.642151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2089ec6f-08e0-4c80-bb3b-2e7d3a9e9de7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:06.642935 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2089ec6f-08e0-4c80-bb3b-2e7d3a9e9de7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:06.643397 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2089ec6f-08e0-4c80-bb3b-2e7d3a9e9de7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:06.783641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2089ec6f-08e0-4c80-bb3b-2e7d3a9e9de7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:06.791922 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2089ec6f-08e0-4c80-bb3b-2e7d3a9e9de7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:06.793483 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2089ec6f-08e0-4c80-bb3b-2e7d3a9e9de7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:06.796325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-2089ec6f-08e0-4c80-bb3b-2e7d3a9e9de7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1751 microversion: 2.20 time: 0.163921 Jul 20 15:35:06.796325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 175/345] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:06 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:07.289568 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-1e8fbd9d-9748-447b-8166-57cba86fc2a8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:07.290194 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-1e8fbd9d-9748-447b-8166-57cba86fc2a8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:07.297138 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1e8fbd9d-9748-447b-8166-57cba86fc2a8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:07.297588 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1e8fbd9d-9748-447b-8166-57cba86fc2a8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:07.298381 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1e8fbd9d-9748-447b-8166-57cba86fc2a8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:07.298815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1e8fbd9d-9748-447b-8166-57cba86fc2a8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:07.431553 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-1e8fbd9d-9748-447b-8166-57cba86fc2a8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:07.441907 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-1e8fbd9d-9748-447b-8166-57cba86fc2a8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1358 microversion: 2.1 time: 0.156126 Jul 20 15:35:07.442856 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 171/346] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:07 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:07.813285 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-34bfd4a2-bb11-4745-a496-9bbaf4927c2d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:07.815053 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-34bfd4a2-bb11-4745-a496-9bbaf4927c2d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:07.821756 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-34bfd4a2-bb11-4745-a496-9bbaf4927c2d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:07.822195 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-34bfd4a2-bb11-4745-a496-9bbaf4927c2d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:07.829253 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-34bfd4a2-bb11-4745-a496-9bbaf4927c2d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:07.829944 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-34bfd4a2-bb11-4745-a496-9bbaf4927c2d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:07.866211 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=2 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:07.989943 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-34bfd4a2-bb11-4745-a496-9bbaf4927c2d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:08.001111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-34bfd4a2-bb11-4745-a496-9bbaf4927c2d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:08.002870 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-34bfd4a2-bb11-4745-a496-9bbaf4927c2d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:08.004451 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-34bfd4a2-bb11-4745-a496-9bbaf4927c2d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1751 microversion: 2.20 time: 0.195823 Jul 20 15:35:08.005267 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 176/347] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:07 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1751 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:08.459881 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-129eafaf-9b54-486e-83c7-9b917e3c9ea1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:08.460640 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-129eafaf-9b54-486e-83c7-9b917e3c9ea1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:08.475556 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-129eafaf-9b54-486e-83c7-9b917e3c9ea1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:08.476014 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-129eafaf-9b54-486e-83c7-9b917e3c9ea1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:08.476794 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-129eafaf-9b54-486e-83c7-9b917e3c9ea1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:08.477237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-129eafaf-9b54-486e-83c7-9b917e3c9ea1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:08.638653 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-129eafaf-9b54-486e-83c7-9b917e3c9ea1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:08.646043 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-129eafaf-9b54-486e-83c7-9b917e3c9ea1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1358 microversion: 2.1 time: 0.190012 Jul 20 15:35:08.646626 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 172/348] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:08 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:09.025049 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-bc9069b5-175e-4d06-a5c4-15d2c1cf06bf tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:09.025657 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-bc9069b5-175e-4d06-a5c4-15d2c1cf06bf tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:09.032626 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bc9069b5-175e-4d06-a5c4-15d2c1cf06bf tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:09.033072 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bc9069b5-175e-4d06-a5c4-15d2c1cf06bf tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:09.033978 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bc9069b5-175e-4d06-a5c4-15d2c1cf06bf tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:09.034515 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bc9069b5-175e-4d06-a5c4-15d2c1cf06bf tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:09.165624 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-bc9069b5-175e-4d06-a5c4-15d2c1cf06bf tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:09.174675 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-bc9069b5-175e-4d06-a5c4-15d2c1cf06bf tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:09.176174 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-bc9069b5-175e-4d06-a5c4-15d2c1cf06bf tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:09.177351 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-bc9069b5-175e-4d06-a5c4-15d2c1cf06bf tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1751 microversion: 2.20 time: 0.156431 Jul 20 15:35:09.177898 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 177/349] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:09 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:09.663141 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-ce0caccb-aaab-44f4-9047-26e200c6f7a6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:09.664455 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-ce0caccb-aaab-44f4-9047-26e200c6f7a6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:09.671228 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ce0caccb-aaab-44f4-9047-26e200c6f7a6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:09.671962 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ce0caccb-aaab-44f4-9047-26e200c6f7a6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:09.672937 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ce0caccb-aaab-44f4-9047-26e200c6f7a6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:09.673574 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ce0caccb-aaab-44f4-9047-26e200c6f7a6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:09.827386 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-ce0caccb-aaab-44f4-9047-26e200c6f7a6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:09.839064 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-ce0caccb-aaab-44f4-9047-26e200c6f7a6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1358 microversion: 2.1 time: 0.179842 Jul 20 15:35:09.840568 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 173/350] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:09 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:10.197063 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-4c1e8784-1ba2-4b40-9ae2-1b3a9c208eaf tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:10.197973 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-4c1e8784-1ba2-4b40-9ae2-1b3a9c208eaf tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:10.205821 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4c1e8784-1ba2-4b40-9ae2-1b3a9c208eaf tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:10.206481 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4c1e8784-1ba2-4b40-9ae2-1b3a9c208eaf tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:10.212105 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4c1e8784-1ba2-4b40-9ae2-1b3a9c208eaf tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:10.212105 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4c1e8784-1ba2-4b40-9ae2-1b3a9c208eaf tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:10.344211 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-4c1e8784-1ba2-4b40-9ae2-1b3a9c208eaf tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:10.352992 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-4c1e8784-1ba2-4b40-9ae2-1b3a9c208eaf tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:10.354575 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-4c1e8784-1ba2-4b40-9ae2-1b3a9c208eaf tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:10.356200 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-4c1e8784-1ba2-4b40-9ae2-1b3a9c208eaf tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1751 microversion: 2.20 time: 0.163645 Jul 20 15:35:10.356751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 178/351] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:10 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:10.857392 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-077e160a-0176-49e9-86b2-2121b4e071d8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:10.858301 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-077e160a-0176-49e9-86b2-2121b4e071d8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:10.865404 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-077e160a-0176-49e9-86b2-2121b4e071d8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:10.866054 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-077e160a-0176-49e9-86b2-2121b4e071d8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:10.867079 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-077e160a-0176-49e9-86b2-2121b4e071d8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:10.867582 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-077e160a-0176-49e9-86b2-2121b4e071d8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:11.016681 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-077e160a-0176-49e9-86b2-2121b4e071d8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:11.026789 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-077e160a-0176-49e9-86b2-2121b4e071d8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1358 microversion: 2.1 time: 0.173418 Jul 20 15:35:11.028686 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 174/352] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:10 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:11.374903 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-28a93fa2-9593-4ed0-a3b7-4905cb993ef6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:11.375804 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-28a93fa2-9593-4ed0-a3b7-4905cb993ef6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:11.377517 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=14 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:11.383244 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-28a93fa2-9593-4ed0-a3b7-4905cb993ef6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:11.383688 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-28a93fa2-9593-4ed0-a3b7-4905cb993ef6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:11.384467 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-28a93fa2-9593-4ed0-a3b7-4905cb993ef6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:11.384888 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-28a93fa2-9593-4ed0-a3b7-4905cb993ef6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:11.635325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-28a93fa2-9593-4ed0-a3b7-4905cb993ef6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:11.643670 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-28a93fa2-9593-4ed0-a3b7-4905cb993ef6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:11.645185 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-28a93fa2-9593-4ed0-a3b7-4905cb993ef6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:11.646477 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-28a93fa2-9593-4ed0-a3b7-4905cb993ef6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1751 microversion: 2.20 time: 0.276078 Jul 20 15:35:11.647417 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 179/353] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:11 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1751 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:12.048866 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-963818a9-dd2d-4075-befd-d92aa24d5a68 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:12.049482 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-963818a9-dd2d-4075-befd-d92aa24d5a68 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:12.051347 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=4 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:12.056261 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-963818a9-dd2d-4075-befd-d92aa24d5a68 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:12.056721 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-963818a9-dd2d-4075-befd-d92aa24d5a68 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:12.057462 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-963818a9-dd2d-4075-befd-d92aa24d5a68 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:12.057893 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-963818a9-dd2d-4075-befd-d92aa24d5a68 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:12.194417 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-963818a9-dd2d-4075-befd-d92aa24d5a68 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:12.203211 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-963818a9-dd2d-4075-befd-d92aa24d5a68 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1358 microversion: 2.1 time: 0.157335 Jul 20 15:35:12.203813 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 175/354] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:12 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:35:12.665110 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-05d44723-67e5-4df7-ad22-b6756a82bb39 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:12.665713 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-05d44723-67e5-4df7-ad22-b6756a82bb39 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:12.672727 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-05d44723-67e5-4df7-ad22-b6756a82bb39 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:12.673457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-05d44723-67e5-4df7-ad22-b6756a82bb39 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:12.674552 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-05d44723-67e5-4df7-ad22-b6756a82bb39 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:12.676551 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-05d44723-67e5-4df7-ad22-b6756a82bb39 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:12.829034 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-05d44723-67e5-4df7-ad22-b6756a82bb39 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:12.847512 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-05d44723-67e5-4df7-ad22-b6756a82bb39 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:12.854425 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-05d44723-67e5-4df7-ad22-b6756a82bb39 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:12.854425 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-05d44723-67e5-4df7-ad22-b6756a82bb39 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1751 microversion: 2.20 time: 0.189490 Jul 20 15:35:12.854425 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 180/355] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:12 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1751 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:13.223918 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-80e54cb9-682b-4e87-912e-fd6ed0bd4072 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:13.224561 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-80e54cb9-682b-4e87-912e-fd6ed0bd4072 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:13.230695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-80e54cb9-682b-4e87-912e-fd6ed0bd4072 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:13.231154 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-80e54cb9-682b-4e87-912e-fd6ed0bd4072 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:13.231922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-80e54cb9-682b-4e87-912e-fd6ed0bd4072 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:13.232356 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-80e54cb9-682b-4e87-912e-fd6ed0bd4072 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:13.407623 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-80e54cb9-682b-4e87-912e-fd6ed0bd4072 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:13.408825 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-80e54cb9-682b-4e87-912e-fd6ed0bd4072 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1358 microversion: 2.1 time: 0.188793 Jul 20 15:35:13.409406 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 176/356] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:13 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:13.869331 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-43377194-9b00-459f-be65-75ede167b854 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:13.869969 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-43377194-9b00-459f-be65-75ede167b854 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:13.876522 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-43377194-9b00-459f-be65-75ede167b854 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:13.877213 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-43377194-9b00-459f-be65-75ede167b854 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:13.877973 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-43377194-9b00-459f-be65-75ede167b854 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:13.878458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-43377194-9b00-459f-be65-75ede167b854 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:14.018838 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-43377194-9b00-459f-be65-75ede167b854 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:14.028544 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-43377194-9b00-459f-be65-75ede167b854 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:14.030381 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-43377194-9b00-459f-be65-75ede167b854 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:14.031734 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-43377194-9b00-459f-be65-75ede167b854 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1751 microversion: 2.20 time: 0.166305 Jul 20 15:35:14.032286 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 181/357] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:13 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:14.426335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-3e532da3-3fb8-443b-856b-22ed5476c71f tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:14.430369 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-3e532da3-3fb8-443b-856b-22ed5476c71f tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:14.432863 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3e532da3-3fb8-443b-856b-22ed5476c71f tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:14.433304 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3e532da3-3fb8-443b-856b-22ed5476c71f tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:14.434657 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3e532da3-3fb8-443b-856b-22ed5476c71f tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:14.435092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3e532da3-3fb8-443b-856b-22ed5476c71f tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:14.592477 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-3e532da3-3fb8-443b-856b-22ed5476c71f tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:14.602018 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-3e532da3-3fb8-443b-856b-22ed5476c71f tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1358 microversion: 2.1 time: 0.179496 Jul 20 15:35:14.603007 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 177/358] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:14 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:15.049975 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-8776495b-eead-4ff3-8c6b-3d57e871cfde tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:15.052391 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-8776495b-eead-4ff3-8c6b-3d57e871cfde tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:15.060318 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8776495b-eead-4ff3-8c6b-3d57e871cfde tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:15.064364 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8776495b-eead-4ff3-8c6b-3d57e871cfde tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:15.065436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8776495b-eead-4ff3-8c6b-3d57e871cfde tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:15.066611 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8776495b-eead-4ff3-8c6b-3d57e871cfde tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:15.257008 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-8776495b-eead-4ff3-8c6b-3d57e871cfde tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:15.267734 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-8776495b-eead-4ff3-8c6b-3d57e871cfde tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:15.269160 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-8776495b-eead-4ff3-8c6b-3d57e871cfde tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:15.270339 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-8776495b-eead-4ff3-8c6b-3d57e871cfde tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1751 microversion: 2.20 time: 0.224508 Jul 20 15:35:15.271081 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 182/359] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:15 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1751 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:15.619259 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-924325ca-0a26-4f86-9888-b332a975df5b tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:15.620032 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-924325ca-0a26-4f86-9888-b332a975df5b tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:15.626599 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-924325ca-0a26-4f86-9888-b332a975df5b tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:15.627052 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-924325ca-0a26-4f86-9888-b332a975df5b tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:15.627812 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-924325ca-0a26-4f86-9888-b332a975df5b tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:15.628301 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-924325ca-0a26-4f86-9888-b332a975df5b tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:15.776669 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-924325ca-0a26-4f86-9888-b332a975df5b tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:15.784950 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-924325ca-0a26-4f86-9888-b332a975df5b tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1358 microversion: 2.1 time: 0.169547 Jul 20 15:35:15.785518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 178/360] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:15 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:35:16.290561 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-8606c4c5-0920-4013-988f-dba48fb164af tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:16.291788 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-8606c4c5-0920-4013-988f-dba48fb164af tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:16.299535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8606c4c5-0920-4013-988f-dba48fb164af tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:16.300006 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8606c4c5-0920-4013-988f-dba48fb164af tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:16.300796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8606c4c5-0920-4013-988f-dba48fb164af tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:16.301247 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8606c4c5-0920-4013-988f-dba48fb164af tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:16.487041 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-8606c4c5-0920-4013-988f-dba48fb164af tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:16.498688 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-8606c4c5-0920-4013-988f-dba48fb164af tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:16.500982 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-8606c4c5-0920-4013-988f-dba48fb164af tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:16.502497 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-8606c4c5-0920-4013-988f-dba48fb164af tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1751 microversion: 2.20 time: 0.215938 Jul 20 15:35:16.515917 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 183/361] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:16 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1751 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:16.805253 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-7adf3798-d576-4d92-96ec-8a153e6b3257 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:16.806041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-7adf3798-d576-4d92-96ec-8a153e6b3257 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:16.816146 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7adf3798-d576-4d92-96ec-8a153e6b3257 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:16.816988 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7adf3798-d576-4d92-96ec-8a153e6b3257 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:16.817991 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7adf3798-d576-4d92-96ec-8a153e6b3257 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:16.818569 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7adf3798-d576-4d92-96ec-8a153e6b3257 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:16.981202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-7adf3798-d576-4d92-96ec-8a153e6b3257 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:16.991046 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-7adf3798-d576-4d92-96ec-8a153e6b3257 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1358 microversion: 2.1 time: 0.189145 Jul 20 15:35:16.992003 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 179/362] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:16 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:17.524677 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-43dde19a-7979-4137-8004-ea5f1315c172 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:17.525374 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-43dde19a-7979-4137-8004-ea5f1315c172 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:17.533599 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-43dde19a-7979-4137-8004-ea5f1315c172 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:17.543409 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-43dde19a-7979-4137-8004-ea5f1315c172 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:17.544388 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-43dde19a-7979-4137-8004-ea5f1315c172 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:17.544928 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-43dde19a-7979-4137-8004-ea5f1315c172 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:17.549450 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:17.744983 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-43dde19a-7979-4137-8004-ea5f1315c172 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:17.754233 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-43dde19a-7979-4137-8004-ea5f1315c172 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:17.755925 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-43dde19a-7979-4137-8004-ea5f1315c172 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:17.757130 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-43dde19a-7979-4137-8004-ea5f1315c172 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1751 microversion: 2.20 time: 0.237019 Jul 20 15:35:17.758720 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 184/363] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:17 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1751 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:18.009402 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-8b1c0ca9-54d0-4e54-b62b-badb1b4ad4a5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:18.009975 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-8b1c0ca9-54d0-4e54-b62b-badb1b4ad4a5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:18.020821 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8b1c0ca9-54d0-4e54-b62b-badb1b4ad4a5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:18.021587 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8b1c0ca9-54d0-4e54-b62b-badb1b4ad4a5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:18.022414 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8b1c0ca9-54d0-4e54-b62b-badb1b4ad4a5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:18.022843 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8b1c0ca9-54d0-4e54-b62b-badb1b4ad4a5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:18.170181 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-8b1c0ca9-54d0-4e54-b62b-badb1b4ad4a5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:18.178692 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-8b1c0ca9-54d0-4e54-b62b-badb1b4ad4a5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1358 microversion: 2.1 time: 0.173435 Jul 20 15:35:18.179273 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 180/364] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:18 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:18.776851 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-bf429077-4945-4ce3-91e4-ef04c6762a8c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:18.776851 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-bf429077-4945-4ce3-91e4-ef04c6762a8c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:18.785094 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bf429077-4945-4ce3-91e4-ef04c6762a8c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:18.785750 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bf429077-4945-4ce3-91e4-ef04c6762a8c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:18.787283 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bf429077-4945-4ce3-91e4-ef04c6762a8c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:18.787848 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bf429077-4945-4ce3-91e4-ef04c6762a8c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:18.942708 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-bf429077-4945-4ce3-91e4-ef04c6762a8c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:18.951968 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-bf429077-4945-4ce3-91e4-ef04c6762a8c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:18.955769 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-bf429077-4945-4ce3-91e4-ef04c6762a8c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:18.957407 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-bf429077-4945-4ce3-91e4-ef04c6762a8c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1751 microversion: 2.20 time: 0.186203 Jul 20 15:35:18.958535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 185/365] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:18 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:19.210603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-365da3a9-b255-4eab-93b9-0878bf95c6ce tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:19.214788 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-365da3a9-b255-4eab-93b9-0878bf95c6ce tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:19.230097 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-365da3a9-b255-4eab-93b9-0878bf95c6ce tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:19.231686 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-365da3a9-b255-4eab-93b9-0878bf95c6ce tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:19.234325 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-365da3a9-b255-4eab-93b9-0878bf95c6ce tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:19.243357 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-365da3a9-b255-4eab-93b9-0878bf95c6ce tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:19.288589 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:19.471716 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-365da3a9-b255-4eab-93b9-0878bf95c6ce tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:19.479550 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-365da3a9-b255-4eab-93b9-0878bf95c6ce tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1358 microversion: 2.1 time: 0.279980 Jul 20 15:35:19.480384 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 181/366] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:19 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1358 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:19.657521 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-b0be4e70-78ef-4ca6-9824-a99e51c21be5 req-42792cfd-62c5-4070-8054-8f64eabffe1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "170181c4-a3e8-494d-bef6-2048dd9b0257", "tag": "3f4230e5-b6b6-43aa-985b-67a345eed1aa"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:35:19.673479 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-b0be4e70-78ef-4ca6-9824-a99e51c21be5 req-42792cfd-62c5-4070-8054-8f64eabffe1c service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:19.673916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-b0be4e70-78ef-4ca6-9824-a99e51c21be5 req-42792cfd-62c5-4070-8054-8f64eabffe1c service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:19.692514 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-b0be4e70-78ef-4ca6-9824-a99e51c21be5 req-42792cfd-62c5-4070-8054-8f64eabffe1c service nova] Creating event network-changed:3f4230e5-b6b6-43aa-985b-67a345eed1aa for instance 170181c4-a3e8-494d-bef6-2048dd9b0257 on hv-cinder-81914 Jul 20 15:35:19.699122 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-b0be4e70-78ef-4ca6-9824-a99e51c21be5 req-42792cfd-62c5-4070-8054-8f64eabffe1c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056870 Jul 20 15:35:19.699811 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 186/367] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:35:19.979195 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d32c2f4a-8332-4d91-999b-907da338581a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:19.980252 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d32c2f4a-8332-4d91-999b-907da338581a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:19.991243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d32c2f4a-8332-4d91-999b-907da338581a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:19.991924 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d32c2f4a-8332-4d91-999b-907da338581a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:19.992916 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d32c2f4a-8332-4d91-999b-907da338581a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:19.993517 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d32c2f4a-8332-4d91-999b-907da338581a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:20.199187 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d32c2f4a-8332-4d91-999b-907da338581a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:20.208773 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d32c2f4a-8332-4d91-999b-907da338581a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:20.210309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d32c2f4a-8332-4d91-999b-907da338581a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:20.211942 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-d32c2f4a-8332-4d91-999b-907da338581a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1807 microversion: 2.20 time: 0.238528 Jul 20 15:35:20.222543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 182/368] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:19 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1807 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:20.498864 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-cd7077a7-4cb7-4071-82a8-9f8b3e79dba6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:20.499570 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-cd7077a7-4cb7-4071-82a8-9f8b3e79dba6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:20.511706 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cd7077a7-4cb7-4071-82a8-9f8b3e79dba6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:20.512651 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cd7077a7-4cb7-4071-82a8-9f8b3e79dba6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:20.513524 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cd7077a7-4cb7-4071-82a8-9f8b3e79dba6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:20.513891 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cd7077a7-4cb7-4071-82a8-9f8b3e79dba6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:20.726591 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-cd7077a7-4cb7-4071-82a8-9f8b3e79dba6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:20.735927 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-cd7077a7-4cb7-4071-82a8-9f8b3e79dba6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1358 microversion: 2.1 time: 0.243577 Jul 20 15:35:20.737034 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 187/369] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:20 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:21.229804 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-4498e0a3-6829-4d75-8f15-e665d3dae539 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:21.230438 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-4498e0a3-6829-4d75-8f15-e665d3dae539 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:21.237845 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4498e0a3-6829-4d75-8f15-e665d3dae539 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:21.238455 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4498e0a3-6829-4d75-8f15-e665d3dae539 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:21.239054 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4498e0a3-6829-4d75-8f15-e665d3dae539 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:21.239485 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4498e0a3-6829-4d75-8f15-e665d3dae539 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:21.420088 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4498e0a3-6829-4d75-8f15-e665d3dae539 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:21.431863 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4498e0a3-6829-4d75-8f15-e665d3dae539 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:21.433498 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4498e0a3-6829-4d75-8f15-e665d3dae539 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:21.434844 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-4498e0a3-6829-4d75-8f15-e665d3dae539 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1807 microversion: 2.20 time: 0.209186 Jul 20 15:35:21.435408 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 183/370] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:21 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:21.758682 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-b9997c79-e0c4-4c96-879b-32dfda33daf3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:21.760191 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-b9997c79-e0c4-4c96-879b-32dfda33daf3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:21.767561 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b9997c79-e0c4-4c96-879b-32dfda33daf3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:21.768452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b9997c79-e0c4-4c96-879b-32dfda33daf3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:21.770623 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b9997c79-e0c4-4c96-879b-32dfda33daf3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:21.771160 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b9997c79-e0c4-4c96-879b-32dfda33daf3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:21.914644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-b9997c79-e0c4-4c96-879b-32dfda33daf3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:21.931304 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-b9997c79-e0c4-4c96-879b-32dfda33daf3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1358 microversion: 2.1 time: 0.178510 Jul 20 15:35:21.942530 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 188/371] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:21 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:22.455892 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-35d3cb7f-cc4f-400f-a436-0313f997d1ef tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:22.456491 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-35d3cb7f-cc4f-400f-a436-0313f997d1ef tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:22.467834 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-35d3cb7f-cc4f-400f-a436-0313f997d1ef tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:22.468446 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-35d3cb7f-cc4f-400f-a436-0313f997d1ef tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:22.469280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-35d3cb7f-cc4f-400f-a436-0313f997d1ef tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:22.469714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-35d3cb7f-cc4f-400f-a436-0313f997d1ef tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:22.713813 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-35d3cb7f-cc4f-400f-a436-0313f997d1ef tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:22.728593 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-35d3cb7f-cc4f-400f-a436-0313f997d1ef tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:22.730514 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-35d3cb7f-cc4f-400f-a436-0313f997d1ef tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:22.735990 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-35d3cb7f-cc4f-400f-a436-0313f997d1ef tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1807 microversion: 2.20 time: 0.285032 Jul 20 15:35:22.745047 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 184/372] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:22 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1807 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:22.955554 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-a4afd2a3-2004-4b24-97f8-69b455079583 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:22.956388 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-a4afd2a3-2004-4b24-97f8-69b455079583 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:22.964199 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a4afd2a3-2004-4b24-97f8-69b455079583 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:22.964672 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a4afd2a3-2004-4b24-97f8-69b455079583 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:22.965830 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a4afd2a3-2004-4b24-97f8-69b455079583 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:22.966283 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a4afd2a3-2004-4b24-97f8-69b455079583 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:23.271473 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-a4afd2a3-2004-4b24-97f8-69b455079583 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:23.280938 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-a4afd2a3-2004-4b24-97f8-69b455079583 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1358 microversion: 2.1 time: 0.329507 Jul 20 15:35:23.287064 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 189/373] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:22 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1358 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:23.765562 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-06a5708a-33ff-424b-8e6b-d25ba2902716 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:23.766365 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-06a5708a-33ff-424b-8e6b-d25ba2902716 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:23.774627 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-06a5708a-33ff-424b-8e6b-d25ba2902716 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:23.775133 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-06a5708a-33ff-424b-8e6b-d25ba2902716 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:23.776294 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-06a5708a-33ff-424b-8e6b-d25ba2902716 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:23.777143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-06a5708a-33ff-424b-8e6b-d25ba2902716 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:24.094980 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-06a5708a-33ff-424b-8e6b-d25ba2902716 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:24.112919 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-06a5708a-33ff-424b-8e6b-d25ba2902716 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:24.147553 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-06a5708a-33ff-424b-8e6b-d25ba2902716 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:24.147553 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-06a5708a-33ff-424b-8e6b-d25ba2902716 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1807 microversion: 2.20 time: 0.362327 Jul 20 15:35:24.147553 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 185/374] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:23 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1807 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:24.306300 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-6857a335-fff0-4b7e-a962-2241eb700586 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:24.307040 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-6857a335-fff0-4b7e-a962-2241eb700586 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:24.323309 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:24.331763 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6857a335-fff0-4b7e-a962-2241eb700586 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:24.332525 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6857a335-fff0-4b7e-a962-2241eb700586 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:24.333972 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6857a335-fff0-4b7e-a962-2241eb700586 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:24.335003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6857a335-fff0-4b7e-a962-2241eb700586 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:24.661174 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-6857a335-fff0-4b7e-a962-2241eb700586 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:24.670383 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-6857a335-fff0-4b7e-a962-2241eb700586 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1358 microversion: 2.1 time: 0.369006 Jul 20 15:35:24.671782 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 190/375] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:24 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1358 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:35:25.141569 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-5be70e12-fe21-45a8-9a96-bd6317124e4a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:25.142231 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-5be70e12-fe21-45a8-9a96-bd6317124e4a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:25.151085 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5be70e12-fe21-45a8-9a96-bd6317124e4a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:25.151601 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5be70e12-fe21-45a8-9a96-bd6317124e4a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:25.152966 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5be70e12-fe21-45a8-9a96-bd6317124e4a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:25.153731 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5be70e12-fe21-45a8-9a96-bd6317124e4a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:25.341793 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-5be70e12-fe21-45a8-9a96-bd6317124e4a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:25.353987 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-5be70e12-fe21-45a8-9a96-bd6317124e4a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:25.356455 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-5be70e12-fe21-45a8-9a96-bd6317124e4a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:25.357684 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-5be70e12-fe21-45a8-9a96-bd6317124e4a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1807 microversion: 2.20 time: 0.219992 Jul 20 15:35:25.367656 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 186/376] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:25 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:25.688132 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-f76a7425-8f21-430d-9c41-60d410dff54c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:25.688765 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-f76a7425-8f21-430d-9c41-60d410dff54c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:25.695701 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f76a7425-8f21-430d-9c41-60d410dff54c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:25.696361 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f76a7425-8f21-430d-9c41-60d410dff54c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:25.697169 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f76a7425-8f21-430d-9c41-60d410dff54c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:25.697659 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f76a7425-8f21-430d-9c41-60d410dff54c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:25.860366 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-f76a7425-8f21-430d-9c41-60d410dff54c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:25.873202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-f76a7425-8f21-430d-9c41-60d410dff54c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1358 microversion: 2.1 time: 0.183969 Jul 20 15:35:25.873202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 191/377] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:25 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:26.386420 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-fb775312-9e90-4a6d-b505-f634902abc0e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:26.387738 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-fb775312-9e90-4a6d-b505-f634902abc0e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:26.395518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fb775312-9e90-4a6d-b505-f634902abc0e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:26.400744 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fb775312-9e90-4a6d-b505-f634902abc0e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:26.403488 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fb775312-9e90-4a6d-b505-f634902abc0e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:26.403488 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fb775312-9e90-4a6d-b505-f634902abc0e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:26.629365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c27e6e57-7145-4f8c-ba26-f146b21e4585 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:26.632233 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c27e6e57-7145-4f8c-ba26-f146b21e4585 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:26.648211 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c27e6e57-7145-4f8c-ba26-f146b21e4585 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:26.648680 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c27e6e57-7145-4f8c-ba26-f146b21e4585 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:26.649432 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c27e6e57-7145-4f8c-ba26-f146b21e4585 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:26.650171 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c27e6e57-7145-4f8c-ba26-f146b21e4585 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:26.829344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-fb775312-9e90-4a6d-b505-f634902abc0e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:26.841959 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-fb775312-9e90-4a6d-b505-f634902abc0e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:26.844561 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-fb775312-9e90-4a6d-b505-f634902abc0e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:26.857135 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-fb775312-9e90-4a6d-b505-f634902abc0e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1807 microversion: 2.20 time: 0.463859 Jul 20 15:35:26.871321 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 187/378] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:26 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1807 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:26.893635 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-f39a16d9-8cdc-4fbe-8b27-4847b5bf6689 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:26.893635 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-f39a16d9-8cdc-4fbe-8b27-4847b5bf6689 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:26.923292 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f39a16d9-8cdc-4fbe-8b27-4847b5bf6689 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:26.923789 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f39a16d9-8cdc-4fbe-8b27-4847b5bf6689 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:26.924667 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f39a16d9-8cdc-4fbe-8b27-4847b5bf6689 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:26.925133 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f39a16d9-8cdc-4fbe-8b27-4847b5bf6689 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:27.036667 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.objects.instance [None req-c27e6e57-7145-4f8c-ba26-f146b21e4585 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lazy-loading 'services' on Instance uuid 7693c05d-ad3d-40fb-8c50-56e655ca708a {{(pid=124711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:35:27.382003 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-f39a16d9-8cdc-4fbe-8b27-4847b5bf6689 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:27.390115 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-f39a16d9-8cdc-4fbe-8b27-4847b5bf6689 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1358 microversion: 2.1 time: 0.507718 Jul 20 15:35:27.396833 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 188/379] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:26 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1358 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:27.414864 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-5808312f-1094-4f28-aa3f-6a8a2a18dd2f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90feec83-6635-4a4c-bcc6-8c3bc1edae76"}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:35:27.419253 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-5808312f-1094-4f28-aa3f-6a8a2a18dd2f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:27.443490 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5808312f-1094-4f28-aa3f-6a8a2a18dd2f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:27.444436 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5808312f-1094-4f28-aa3f-6a8a2a18dd2f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:27.445456 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5808312f-1094-4f28-aa3f-6a8a2a18dd2f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:27.446475 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5808312f-1094-4f28-aa3f-6a8a2a18dd2f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:27.485592 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c27e6e57-7145-4f8c-ba26-f146b21e4585 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a/os-volume_attachments/1100061b-09d3-4fef-816b-d76241f39ef0" status: 202 len: 0 microversion: 2.1 time: 0.866382 Jul 20 15:35:27.498417 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 192/380] 10.222.0.78 () {58 vars in 1415 bytes} [Wed Jul 20 15:35:26 2022] DELETE /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a/os-volume_attachments/1100061b-09d3-4fef-816b-d76241f39ef0 => generated 0 bytes in 880 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:35:27.880249 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-23ce1791-3723-43ff-b734-d64cd23a057e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:27.883622 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-23ce1791-3723-43ff-b734-d64cd23a057e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:27.904837 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-23ce1791-3723-43ff-b734-d64cd23a057e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:27.907346 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-23ce1791-3723-43ff-b734-d64cd23a057e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:27.908345 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-23ce1791-3723-43ff-b734-d64cd23a057e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:27.908943 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-23ce1791-3723-43ff-b734-d64cd23a057e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:28.190637 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-23ce1791-3723-43ff-b734-d64cd23a057e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:28.208533 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-23ce1791-3723-43ff-b734-d64cd23a057e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:28.218310 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-23ce1791-3723-43ff-b734-d64cd23a057e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:28.219640 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-23ce1791-3723-43ff-b734-d64cd23a057e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1807 microversion: 2.20 time: 0.351707 Jul 20 15:35:28.220231 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 193/381] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:27 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1807 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:28.414711 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d3612dab-84bc-4741-8dd9-c1941d46dde8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:28.415689 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-d3612dab-84bc-4741-8dd9-c1941d46dde8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:28.422962 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d3612dab-84bc-4741-8dd9-c1941d46dde8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:28.423740 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d3612dab-84bc-4741-8dd9-c1941d46dde8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:28.424728 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d3612dab-84bc-4741-8dd9-c1941d46dde8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:28.425360 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d3612dab-84bc-4741-8dd9-c1941d46dde8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:28.540721 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-5808312f-1094-4f28-aa3f-6a8a2a18dd2f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "POST /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.142510 Jul 20 15:35:28.548772 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 189/382] 10.222.0.78 () {60 vars in 1322 bytes} [Wed Jul 20 15:35:27 2022] POST /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994/os-volume_attachments => generated 194 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:35:28.871216 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d3612dab-84bc-4741-8dd9-c1941d46dde8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:28.892905 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d3612dab-84bc-4741-8dd9-c1941d46dde8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1358 microversion: 2.1 time: 0.481927 Jul 20 15:35:28.897282 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 194/383] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:28 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1358 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:29.241288 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-cd286968-a864-4027-be3f-37972c527ad5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:29.242431 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-cd286968-a864-4027-be3f-37972c527ad5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:29.259550 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cd286968-a864-4027-be3f-37972c527ad5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:29.361296 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cd286968-a864-4027-be3f-37972c527ad5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:29.361296 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cd286968-a864-4027-be3f-37972c527ad5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:29.361296 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cd286968-a864-4027-be3f-37972c527ad5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:29.379522 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-b0a3426b-b92d-4484-9bd6-f75aee0579fb req-7b48642e-044c-4591-a4b0-cb831ad26e99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "170181c4-a3e8-494d-bef6-2048dd9b0257", "name": "network-vif-plugged", "status": "completed", "tag": "3f4230e5-b6b6-43aa-985b-67a345eed1aa"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:35:29.405292 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-b0a3426b-b92d-4484-9bd6-f75aee0579fb req-7b48642e-044c-4591-a4b0-cb831ad26e99 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:29.420683 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-b0a3426b-b92d-4484-9bd6-f75aee0579fb req-7b48642e-044c-4591-a4b0-cb831ad26e99 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:29.457049 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-b0a3426b-b92d-4484-9bd6-f75aee0579fb req-7b48642e-044c-4591-a4b0-cb831ad26e99 service nova] Creating event network-vif-plugged:3f4230e5-b6b6-43aa-985b-67a345eed1aa for instance 170181c4-a3e8-494d-bef6-2048dd9b0257 on hv-cinder-81914 Jul 20 15:35:29.473749 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-b0a3426b-b92d-4484-9bd6-f75aee0579fb req-7b48642e-044c-4591-a4b0-cb831ad26e99 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099157 Jul 20 15:35:29.478534 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 195/384] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:35:29.513750 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-da60f901-abbd-4212-a136-f8c21023e447 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1168674510", "imageRef": "80914b1c-623c-42a8-810e-836b2cce0d3b", "flavorRef": "452", "networks": [{"uuid": "f8cc0700-5535-424a-ac7f-e08c5c1408c4"}]}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:35:29.629239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.network.neutron [None req-da60f901-abbd-4212-a136-f8c21023e447 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] validate_networks() for [('f8cc0700-5535-424a-ac7f-e08c5c1408c4', None, None, None, None, None)] {{(pid=124711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 15:35:29.788884 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-cd286968-a864-4027-be3f-37972c527ad5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:29.828021 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-cd286968-a864-4027-be3f-37972c527ad5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:29.832346 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-cd286968-a864-4027-be3f-37972c527ad5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:29.832346 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-cd286968-a864-4027-be3f-37972c527ad5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1807 microversion: 2.20 time: 0.594538 Jul 20 15:35:29.832346 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 190/385] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:29 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1807 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:29.913139 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b130493c-de13-4884-9550-50387b529370 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:29.914114 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b130493c-de13-4884-9550-50387b529370 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:29.927254 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b130493c-de13-4884-9550-50387b529370 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:29.928653 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b130493c-de13-4884-9550-50387b529370 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:29.937138 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b130493c-de13-4884-9550-50387b529370 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:29.938868 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b130493c-de13-4884-9550-50387b529370 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:30.488110 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b130493c-de13-4884-9550-50387b529370 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:30.509975 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b130493c-de13-4884-9550-50387b529370 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1358 microversion: 2.1 time: 0.600577 Jul 20 15:35:30.514595 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 191/386] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:29 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1358 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:35:30.521990 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-38ffe34c-9b70-4cd3-b82f-04ff164d1370 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:35:30.533287 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-38ffe34c-9b70-4cd3-b82f-04ff164d1370 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:30.534252 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-38ffe34c-9b70-4cd3-b82f-04ff164d1370 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:30.589295 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-38ffe34c-9b70-4cd3-b82f-04ff164d1370 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Going to try to stop instance {{(pid=124712) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 15:35:30.733315 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-da60f901-abbd-4212-a136-f8c21023e447 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Flavor limits 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 15:35:30.733315 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-da60f901-abbd-4212-a136-f8c21023e447 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Image limits 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 15:35:30.733315 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-da60f901-abbd-4212-a136-f8c21023e447 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Flavor pref 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 15:35:30.733315 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-da60f901-abbd-4212-a136-f8c21023e447 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Image pref 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 15:35:30.733315 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-da60f901-abbd-4212-a136-f8c21023e447 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 15:35:30.739818 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-da60f901-abbd-4212-a136-f8c21023e447 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:30.740643 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-da60f901-abbd-4212-a136-f8c21023e447 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:30.741846 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-da60f901-abbd-4212-a136-f8c21023e447 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:30.752967 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-da60f901-abbd-4212-a136-f8c21023e447 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:30.796214 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-da60f901-abbd-4212-a136-f8c21023e447 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Getting quotas for project 3e3b499bb69b4b449a2e2515d94094fb. Resources: {'instances', 'ram', 'cores'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:35:30.801071 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-da60f901-abbd-4212-a136-f8c21023e447 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Getting quotas for user 9ea2abd1398f4fba93b3b7a5beb52ba0 and project 3e3b499bb69b4b449a2e2515d94094fb. Resources: {'instances', 'ram', 'cores'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:35:30.813024 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-38ffe34c-9b70-4cd3-b82f-04ff164d1370 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "POST /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a/action" status: 202 len: 0 microversion: 2.1 time: 0.296479 Jul 20 15:35:30.830870 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 192/387] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Jul 20 15:35:30 2022] POST /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:35:30.840806 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-da60f901-abbd-4212-a136-f8c21023e447 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Going to run 1 instances... {{(pid=124711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 15:35:30.842945 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-3d971332-bf4a-424e-9a85-dee5dd604f8e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:30.849270 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-da60f901-abbd-4212-a136-f8c21023e447 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80914b1c-623c-42a8-810e-836b2cce0d3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 15:35:30.855821 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-3d971332-bf4a-424e-9a85-dee5dd604f8e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:30.876315 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3d971332-bf4a-424e-9a85-dee5dd604f8e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:30.880347 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3d971332-bf4a-424e-9a85-dee5dd604f8e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:30.881201 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3d971332-bf4a-424e-9a85-dee5dd604f8e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:30.890695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3d971332-bf4a-424e-9a85-dee5dd604f8e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:31.049285 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-da60f901-abbd-4212-a136-f8c21023e447 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.568904 Jul 20 15:35:31.053160 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 196/388] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Jul 20 15:35:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 15:35:31.068821 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c2301fc1-68f3-4a14-b956-3b2bad9b14b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:31.069751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c2301fc1-68f3-4a14-b956-3b2bad9b14b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:31.098710 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c2301fc1-68f3-4a14-b956-3b2bad9b14b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:31.099928 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c2301fc1-68f3-4a14-b956-3b2bad9b14b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:31.105342 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c2301fc1-68f3-4a14-b956-3b2bad9b14b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:31.108307 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c2301fc1-68f3-4a14-b956-3b2bad9b14b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:31.382328 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-3d971332-bf4a-424e-9a85-dee5dd604f8e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:31.399030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-3d971332-bf4a-424e-9a85-dee5dd604f8e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1677 microversion: 2.1 time: 0.563779 Jul 20 15:35:31.409698 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 193/389] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:30 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1677 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:31.415620 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-4c7cffaa-0b65-4a7e-8dbf-8e70fdad364a tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:31.416574 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-4c7cffaa-0b65-4a7e-8dbf-8e70fdad364a tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:31.517852 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4c7cffaa-0b65-4a7e-8dbf-8e70fdad364a tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:31.532353 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-4c7cffaa-0b65-4a7e-8dbf-8e70fdad364a tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 200 len: 1219 microversion: 2.1 time: 0.121164 Jul 20 15:35:31.537091 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 194/390] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:31 2022] GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 1219 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:31.539568 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-7eb997bf-8e48-4a37-93fa-ea519b9c4583 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:31.540736 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-7eb997bf-8e48-4a37-93fa-ea519b9c4583 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:31.548534 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c2301fc1-68f3-4a14-b956-3b2bad9b14b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:31.549496 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7eb997bf-8e48-4a37-93fa-ea519b9c4583 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:31.550039 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7eb997bf-8e48-4a37-93fa-ea519b9c4583 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:31.551354 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7eb997bf-8e48-4a37-93fa-ea519b9c4583 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:31.552559 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7eb997bf-8e48-4a37-93fa-ea519b9c4583 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:31.559150 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c2301fc1-68f3-4a14-b956-3b2bad9b14b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:31.563781 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c2301fc1-68f3-4a14-b956-3b2bad9b14b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:31.565175 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c2301fc1-68f3-4a14-b956-3b2bad9b14b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1807 microversion: 2.20 time: 0.503196 Jul 20 15:35:31.565900 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 197/391] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:31 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1807 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:31.799558 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-7eb997bf-8e48-4a37-93fa-ea519b9c4583 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:31.811533 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-7eb997bf-8e48-4a37-93fa-ea519b9c4583 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1358 microversion: 2.1 time: 0.276874 Jul 20 15:35:31.823180 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 195/392] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:31 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1358 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:32.418195 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-7a40f477-3194-49cb-8c7c-1f3dc6b1fa0d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:32.419606 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-7a40f477-3194-49cb-8c7c-1f3dc6b1fa0d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:32.428761 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7a40f477-3194-49cb-8c7c-1f3dc6b1fa0d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:32.429506 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7a40f477-3194-49cb-8c7c-1f3dc6b1fa0d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:32.430063 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7a40f477-3194-49cb-8c7c-1f3dc6b1fa0d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:32.430522 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7a40f477-3194-49cb-8c7c-1f3dc6b1fa0d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:32.550041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d534088c-0811-4a34-a2ef-905ff2a2d232 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:32.550732 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d534088c-0811-4a34-a2ef-905ff2a2d232 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:32.724038 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d534088c-0811-4a34-a2ef-905ff2a2d232 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:32.759243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-d534088c-0811-4a34-a2ef-905ff2a2d232 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 200 len: 1219 microversion: 2.1 time: 0.212370 Jul 20 15:35:32.761971 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 196/393] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:32 2022] GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 1219 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:35:32.775786 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-480b2487-3ae8-4704-8b4f-93daa7ea7f02 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:32.778895 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-480b2487-3ae8-4704-8b4f-93daa7ea7f02 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:32.803712 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=66 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:32.811391 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-480b2487-3ae8-4704-8b4f-93daa7ea7f02 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:32.813579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-480b2487-3ae8-4704-8b4f-93daa7ea7f02 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:32.816617 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-480b2487-3ae8-4704-8b4f-93daa7ea7f02 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:32.817215 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-480b2487-3ae8-4704-8b4f-93daa7ea7f02 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:32.863931 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-7a40f477-3194-49cb-8c7c-1f3dc6b1fa0d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:32.877622 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-7a40f477-3194-49cb-8c7c-1f3dc6b1fa0d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1677 microversion: 2.1 time: 0.462204 Jul 20 15:35:32.881626 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 198/394] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:32 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1677 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:32.891203 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ebf6987c-b462-4206-ad36-cfe226b26ef8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:32.892174 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ebf6987c-b462-4206-ad36-cfe226b26ef8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:32.900237 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ebf6987c-b462-4206-ad36-cfe226b26ef8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:32.900713 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ebf6987c-b462-4206-ad36-cfe226b26ef8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:32.902514 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ebf6987c-b462-4206-ad36-cfe226b26ef8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:32.903339 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ebf6987c-b462-4206-ad36-cfe226b26ef8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:33.125866 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-480b2487-3ae8-4704-8b4f-93daa7ea7f02 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:33.126373 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-ebf6987c-b462-4206-ad36-cfe226b26ef8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:33.129308 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:33.134568 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-ebf6987c-b462-4206-ad36-cfe226b26ef8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1358 microversion: 2.1 time: 0.251477 Jul 20 15:35:33.135455 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 199/395] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:32 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:33.141987 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-480b2487-3ae8-4704-8b4f-93daa7ea7f02 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:33.143668 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-480b2487-3ae8-4704-8b4f-93daa7ea7f02 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:33.144852 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-480b2487-3ae8-4704-8b4f-93daa7ea7f02 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1807 microversion: 2.20 time: 0.381512 Jul 20 15:35:33.145617 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 197/396] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:32 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1807 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:33.778015 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c0dee452-28fa-4dec-9594-b0a774d7a999 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:33.778015 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c0dee452-28fa-4dec-9594-b0a774d7a999 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:33.791538 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c0dee452-28fa-4dec-9594-b0a774d7a999 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:33.792007 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c0dee452-28fa-4dec-9594-b0a774d7a999 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:33.793471 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c0dee452-28fa-4dec-9594-b0a774d7a999 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:33.810727 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c0dee452-28fa-4dec-9594-b0a774d7a999 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:33.895599 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c0dee452-28fa-4dec-9594-b0a774d7a999 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:33.895835 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-c8c6b900-f943-4e43-8d91-14dda8f2ef4b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:33.896545 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-c8c6b900-f943-4e43-8d91-14dda8f2ef4b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:33.904720 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c0dee452-28fa-4dec-9594-b0a774d7a999 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 200 len: 1223 microversion: 2.1 time: 0.132141 Jul 20 15:35:33.905076 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c8c6b900-f943-4e43-8d91-14dda8f2ef4b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:33.905629 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c8c6b900-f943-4e43-8d91-14dda8f2ef4b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:33.906547 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c8c6b900-f943-4e43-8d91-14dda8f2ef4b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:33.907241 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c8c6b900-f943-4e43-8d91-14dda8f2ef4b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:33.925528 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 200/397] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:33 2022] GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 1223 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:34.097017 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-c8c6b900-f943-4e43-8d91-14dda8f2ef4b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:34.108491 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-c8c6b900-f943-4e43-8d91-14dda8f2ef4b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1677 microversion: 2.1 time: 0.218778 Jul 20 15:35:34.109741 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 198/398] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:33 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1677 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:34.152095 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ca422024-4e4f-42bc-9efa-070b4870f4dc tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:34.152990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ca422024-4e4f-42bc-9efa-070b4870f4dc tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:34.161525 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ca422024-4e4f-42bc-9efa-070b4870f4dc tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:34.162424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ca422024-4e4f-42bc-9efa-070b4870f4dc tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:34.163914 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ca422024-4e4f-42bc-9efa-070b4870f4dc tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:34.164516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ca422024-4e4f-42bc-9efa-070b4870f4dc tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:34.168644 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-909043d1-74a8-4929-9a74-c2b62200d481 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:34.169983 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-909043d1-74a8-4929-9a74-c2b62200d481 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:34.177154 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-909043d1-74a8-4929-9a74-c2b62200d481 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:34.177923 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-909043d1-74a8-4929-9a74-c2b62200d481 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:34.178971 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-909043d1-74a8-4929-9a74-c2b62200d481 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:34.179563 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-909043d1-74a8-4929-9a74-c2b62200d481 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:34.661013 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-909043d1-74a8-4929-9a74-c2b62200d481 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:34.664254 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-ca422024-4e4f-42bc-9efa-070b4870f4dc tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:34.674307 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-ca422024-4e4f-42bc-9efa-070b4870f4dc tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1549 microversion: 2.1 time: 0.526551 Jul 20 15:35:34.674844 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-909043d1-74a8-4929-9a74-c2b62200d481 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:34.676500 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 201/399] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:34 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1549 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:35:34.689652 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-909043d1-74a8-4929-9a74-c2b62200d481 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:34.691255 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-909043d1-74a8-4929-9a74-c2b62200d481 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1807 microversion: 2.20 time: 0.531563 Jul 20 15:35:34.692120 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 199/400] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:34 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1807 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:35:34.695258 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-09944d68-9c7b-421e-b8d8-667f4d25bcd3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:34.696131 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-09944d68-9c7b-421e-b8d8-667f4d25bcd3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:34.704003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-09944d68-9c7b-421e-b8d8-667f4d25bcd3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:34.704458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-09944d68-9c7b-421e-b8d8-667f4d25bcd3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:34.705277 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-09944d68-9c7b-421e-b8d8-667f4d25bcd3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:34.705720 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-09944d68-9c7b-421e-b8d8-667f4d25bcd3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:34.731034 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:34.895170 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-09944d68-9c7b-421e-b8d8-667f4d25bcd3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:34.903191 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-09944d68-9c7b-421e-b8d8-667f4d25bcd3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1549 microversion: 2.1 time: 0.212402 Jul 20 15:35:34.903690 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 202/401] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:34 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1549 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:35:34.919897 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-5cd20800-48cd-4473-81ca-1bee834c809c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:34.922861 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-800565e4-f2e1-470f-b0fc-0ad1352562a2 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:34.923493 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-5cd20800-48cd-4473-81ca-1bee834c809c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:34.924726 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-800565e4-f2e1-470f-b0fc-0ad1352562a2 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:34.924999 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-5cd20800-48cd-4473-81ca-1bee834c809c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Searching by: {'deleted': False, 'project_id': '8793a880033e400d89ac8de5a30003b7'} {{(pid=124712) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 15:35:34.936474 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-800565e4-f2e1-470f-b0fc-0ad1352562a2 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:34.937968 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-800565e4-f2e1-470f-b0fc-0ad1352562a2 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:34.938599 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5cd20800-48cd-4473-81ca-1bee834c809c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:34.939530 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-800565e4-f2e1-470f-b0fc-0ad1352562a2 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:34.940122 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-800565e4-f2e1-470f-b0fc-0ad1352562a2 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:34.940321 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5cd20800-48cd-4473-81ca-1bee834c809c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:34.941292 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5cd20800-48cd-4473-81ca-1bee834c809c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:34.941898 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5cd20800-48cd-4473-81ca-1bee834c809c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:35.034733 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-800565e4-f2e1-470f-b0fc-0ad1352562a2 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:35.045047 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-800565e4-f2e1-470f-b0fc-0ad1352562a2 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 200 len: 1271 microversion: 2.1 time: 0.126271 Jul 20 15:35:35.054761 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 203/402] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:34 2022] GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 1271 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:35:35.069327 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.multi_cell_list [None req-5cd20800-48cd-4473-81ca-1bee834c809c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124712) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 15:35:35.128891 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-a8d62908-83ea-4d15-8309-e94c6d14c399 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:35.130198 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-a8d62908-83ea-4d15-8309-e94c6d14c399 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:35.138065 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a8d62908-83ea-4d15-8309-e94c6d14c399 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:35.138665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a8d62908-83ea-4d15-8309-e94c6d14c399 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:35.140001 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a8d62908-83ea-4d15-8309-e94c6d14c399 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:35.140522 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a8d62908-83ea-4d15-8309-e94c6d14c399 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:35.190036 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-5cd20800-48cd-4473-81ca-1bee834c809c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.274979 Jul 20 15:35:35.191084 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 200/403] 10.222.0.78 () {58 vars in 1124 bytes} [Wed Jul 20 15:35:34 2022] GET /compute/v2.1/servers => generated 342 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:35:35.204775 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-f99b9a23-9201-4c9c-9e96-1d124bbc050e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:35.205398 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-f99b9a23-9201-4c9c-9e96-1d124bbc050e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:35.216379 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f99b9a23-9201-4c9c-9e96-1d124bbc050e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:35.216824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f99b9a23-9201-4c9c-9e96-1d124bbc050e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:35.217780 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f99b9a23-9201-4c9c-9e96-1d124bbc050e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:35.218412 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f99b9a23-9201-4c9c-9e96-1d124bbc050e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:35.409651 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-a8d62908-83ea-4d15-8309-e94c6d14c399 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:35.418985 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-a8d62908-83ea-4d15-8309-e94c6d14c399 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1677 microversion: 2.1 time: 0.295533 Jul 20 15:35:35.420293 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 204/404] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:35 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1677 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:35.448947 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-f99b9a23-9201-4c9c-9e96-1d124bbc050e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:35.458107 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-f99b9a23-9201-4c9c-9e96-1d124bbc050e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1549 microversion: 2.1 time: 0.257205 Jul 20 15:35:35.459415 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 201/405] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:35 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1549 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:35.710441 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ddff5c53-943a-4477-a92b-50f31f2c7f05 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:35.711321 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ddff5c53-943a-4477-a92b-50f31f2c7f05 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:35.722583 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ddff5c53-943a-4477-a92b-50f31f2c7f05 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:35.723182 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ddff5c53-943a-4477-a92b-50f31f2c7f05 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:35.723958 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ddff5c53-943a-4477-a92b-50f31f2c7f05 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:35.724501 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ddff5c53-943a-4477-a92b-50f31f2c7f05 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:35.914329 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-ddff5c53-943a-4477-a92b-50f31f2c7f05 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:35.924295 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-ddff5c53-943a-4477-a92b-50f31f2c7f05 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:35.925763 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-ddff5c53-943a-4477-a92b-50f31f2c7f05 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:35.930366 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-ddff5c53-943a-4477-a92b-50f31f2c7f05 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1807 microversion: 2.20 time: 0.221188 Jul 20 15:35:35.934065 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 205/406] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:35 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:36.065603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-5bf1ab26-e17a-496c-a6fa-f218d2d75628 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:36.069077 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-5bf1ab26-e17a-496c-a6fa-f218d2d75628 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:36.077850 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5bf1ab26-e17a-496c-a6fa-f218d2d75628 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:36.078668 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5bf1ab26-e17a-496c-a6fa-f218d2d75628 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:36.080257 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5bf1ab26-e17a-496c-a6fa-f218d2d75628 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:36.081368 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5bf1ab26-e17a-496c-a6fa-f218d2d75628 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:36.161546 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-5bf1ab26-e17a-496c-a6fa-f218d2d75628 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:36.172934 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-5bf1ab26-e17a-496c-a6fa-f218d2d75628 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 200 len: 1277 microversion: 2.1 time: 0.113369 Jul 20 15:35:36.173524 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 202/407] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:36 2022] GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 1277 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:36.436719 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-a1527305-d71c-4bc9-af75-e593a7333107 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:36.437328 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-a1527305-d71c-4bc9-af75-e593a7333107 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:36.443511 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a1527305-d71c-4bc9-af75-e593a7333107 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:36.443953 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a1527305-d71c-4bc9-af75-e593a7333107 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:36.444914 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a1527305-d71c-4bc9-af75-e593a7333107 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:36.445520 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a1527305-d71c-4bc9-af75-e593a7333107 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:36.619533 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-a1527305-d71c-4bc9-af75-e593a7333107 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:36.641849 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-a1527305-d71c-4bc9-af75-e593a7333107 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1677 microversion: 2.1 time: 0.201657 Jul 20 15:35:36.641849 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 206/408] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:36 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1677 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:35:36.955228 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-146e4f0c-c58d-498c-bc32-0e9edd3108f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:36.957314 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-146e4f0c-c58d-498c-bc32-0e9edd3108f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:36.967885 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-146e4f0c-c58d-498c-bc32-0e9edd3108f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:36.969010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-146e4f0c-c58d-498c-bc32-0e9edd3108f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:36.970728 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-146e4f0c-c58d-498c-bc32-0e9edd3108f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:36.972842 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-146e4f0c-c58d-498c-bc32-0e9edd3108f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:37.150869 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-146e4f0c-c58d-498c-bc32-0e9edd3108f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:37.163202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-146e4f0c-c58d-498c-bc32-0e9edd3108f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:37.164830 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-146e4f0c-c58d-498c-bc32-0e9edd3108f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:37.177455 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-146e4f0c-c58d-498c-bc32-0e9edd3108f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1807 microversion: 2.20 time: 0.220775 Jul 20 15:35:37.177455 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 203/409] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:36 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:37.190773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e90ada8e-f6cb-42ac-8dce-4c0d95b0ddfc tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:37.191586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e90ada8e-f6cb-42ac-8dce-4c0d95b0ddfc tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:37.199174 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e90ada8e-f6cb-42ac-8dce-4c0d95b0ddfc tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:37.199773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e90ada8e-f6cb-42ac-8dce-4c0d95b0ddfc tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:37.200401 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e90ada8e-f6cb-42ac-8dce-4c0d95b0ddfc tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:37.201042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e90ada8e-f6cb-42ac-8dce-4c0d95b0ddfc tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:37.358830 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e90ada8e-f6cb-42ac-8dce-4c0d95b0ddfc tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:37.367412 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e90ada8e-f6cb-42ac-8dce-4c0d95b0ddfc tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 200 len: 1319 microversion: 2.1 time: 0.180507 Jul 20 15:35:37.368349 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 207/410] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:37 2022] GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:37.651907 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-3ac8f7d7-dca6-4ca8-bdab-f4dd99ece8b0 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:37.652609 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-3ac8f7d7-dca6-4ca8-bdab-f4dd99ece8b0 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:37.660853 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3ac8f7d7-dca6-4ca8-bdab-f4dd99ece8b0 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:37.661658 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3ac8f7d7-dca6-4ca8-bdab-f4dd99ece8b0 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:37.662670 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3ac8f7d7-dca6-4ca8-bdab-f4dd99ece8b0 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:37.663300 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3ac8f7d7-dca6-4ca8-bdab-f4dd99ece8b0 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:37.711657 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-bab8ff52-fb1a-479b-afc5-32d5e171f8e3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "356963b2-cfc2-4f89-82c5-dc487d359a19"}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:35:37.712939 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-bab8ff52-fb1a-479b-afc5-32d5e171f8e3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:37.720381 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bab8ff52-fb1a-479b-afc5-32d5e171f8e3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:37.721037 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bab8ff52-fb1a-479b-afc5-32d5e171f8e3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:37.721930 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bab8ff52-fb1a-479b-afc5-32d5e171f8e3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:37.722498 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bab8ff52-fb1a-479b-afc5-32d5e171f8e3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:37.842712 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-3ac8f7d7-dca6-4ca8-bdab-f4dd99ece8b0 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:37.854573 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-3ac8f7d7-dca6-4ca8-bdab-f4dd99ece8b0 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1677 microversion: 2.1 time: 0.207079 Jul 20 15:35:37.855164 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 204/411] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:37 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1677 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:38.186017 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-59470e72-3383-4908-9419-680190846468 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:38.186017 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-59470e72-3383-4908-9419-680190846468 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:38.196296 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-59470e72-3383-4908-9419-680190846468 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:38.197027 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-59470e72-3383-4908-9419-680190846468 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:38.198101 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-59470e72-3383-4908-9419-680190846468 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:38.200322 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-59470e72-3383-4908-9419-680190846468 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:38.395580 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-59470e72-3383-4908-9419-680190846468 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:38.404135 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-59470e72-3383-4908-9419-680190846468 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:38.405629 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-59470e72-3383-4908-9419-680190846468 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:38.406811 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-59470e72-3383-4908-9419-680190846468 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1807 microversion: 2.20 time: 0.225995 Jul 20 15:35:38.407364 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 205/412] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:38 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1807 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:35:38.414626 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-dd9a6e7b-5966-4693-9487-9735785343cd tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:38.415307 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-dd9a6e7b-5966-4693-9487-9735785343cd tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:38.423271 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dd9a6e7b-5966-4693-9487-9735785343cd tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:38.423778 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dd9a6e7b-5966-4693-9487-9735785343cd tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:38.424609 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dd9a6e7b-5966-4693-9487-9735785343cd tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:38.425105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dd9a6e7b-5966-4693-9487-9735785343cd tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:38.621343 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-dd9a6e7b-5966-4693-9487-9735785343cd tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:38.630278 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-dd9a6e7b-5966-4693-9487-9735785343cd tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 200 len: 1319 microversion: 2.1 time: 0.220958 Jul 20 15:35:38.630880 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 206/413] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:38 2022] GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:38.663462 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-bab8ff52-fb1a-479b-afc5-32d5e171f8e3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "POST /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.955791 Jul 20 15:35:38.666560 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 208/414] 10.222.0.78 () {60 vars in 1322 bytes} [Wed Jul 20 15:35:37 2022] POST /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257/os-volume_attachments => generated 194 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:35:38.831569 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-6ef0938a-334d-4238-b18b-de243803faaf req-1b3f6070-480a-43df-bea8-115d6973717b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6854fb03-c976-4d6f-88ff-8060777c67bc", "tag": "5ea8bb63-cd9c-4e67-8488-ff3991760128"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:35:38.845644 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-6ef0938a-334d-4238-b18b-de243803faaf req-1b3f6070-480a-43df-bea8-115d6973717b service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:38.846194 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-6ef0938a-334d-4238-b18b-de243803faaf req-1b3f6070-480a-43df-bea8-115d6973717b service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:38.880066 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-6ef0938a-334d-4238-b18b-de243803faaf req-1b3f6070-480a-43df-bea8-115d6973717b service nova] Creating event network-changed:5ea8bb63-cd9c-4e67-8488-ff3991760128 for instance 6854fb03-c976-4d6f-88ff-8060777c67bc on hv-cinder-81914 Jul 20 15:35:38.882778 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-10899585-f256-447c-a76c-14865584cd19 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:38.882778 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-10899585-f256-447c-a76c-14865584cd19 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:38.885801 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-6ef0938a-334d-4238-b18b-de243803faaf req-1b3f6070-480a-43df-bea8-115d6973717b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060864 Jul 20 15:35:38.886763 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 207/415] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:35:38.889605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-10899585-f256-447c-a76c-14865584cd19 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:38.890058 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-10899585-f256-447c-a76c-14865584cd19 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:38.890886 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-10899585-f256-447c-a76c-14865584cd19 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:38.891324 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-10899585-f256-447c-a76c-14865584cd19 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:39.099158 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-10899585-f256-447c-a76c-14865584cd19 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:39.109609 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-10899585-f256-447c-a76c-14865584cd19 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1677 microversion: 2.1 time: 0.239933 Jul 20 15:35:39.118172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 209/416] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:38 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1677 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:39.427382 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-eeecb592-c6b0-4799-ae4f-56fd6d6bc8f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:39.428175 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-eeecb592-c6b0-4799-ae4f-56fd6d6bc8f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:39.438948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-eeecb592-c6b0-4799-ae4f-56fd6d6bc8f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:39.439403 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-eeecb592-c6b0-4799-ae4f-56fd6d6bc8f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:39.440332 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-eeecb592-c6b0-4799-ae4f-56fd6d6bc8f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:39.440778 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-eeecb592-c6b0-4799-ae4f-56fd6d6bc8f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:39.602189 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-eeecb592-c6b0-4799-ae4f-56fd6d6bc8f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:39.615995 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-eeecb592-c6b0-4799-ae4f-56fd6d6bc8f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:39.627192 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-eeecb592-c6b0-4799-ae4f-56fd6d6bc8f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:39.627192 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-eeecb592-c6b0-4799-ae4f-56fd6d6bc8f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1807 microversion: 2.20 time: 0.198503 Jul 20 15:35:39.627192 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 208/417] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:39 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1807 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:39.648566 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-6f5754b5-010a-441a-a800-0e06257657cb tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:39.649490 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-6f5754b5-010a-441a-a800-0e06257657cb tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:39.656164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6f5754b5-010a-441a-a800-0e06257657cb tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:39.656621 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6f5754b5-010a-441a-a800-0e06257657cb tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:39.657408 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6f5754b5-010a-441a-a800-0e06257657cb tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:39.657843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6f5754b5-010a-441a-a800-0e06257657cb tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:39.819379 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-6f5754b5-010a-441a-a800-0e06257657cb tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:39.829704 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-6f5754b5-010a-441a-a800-0e06257657cb tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 200 len: 1319 microversion: 2.1 time: 0.185776 Jul 20 15:35:39.830305 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 210/418] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:39 2022] GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:40.133601 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-386c87cf-de13-4f00-856e-f25473031a52 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:40.134129 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-386c87cf-de13-4f00-856e-f25473031a52 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:40.142081 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-386c87cf-de13-4f00-856e-f25473031a52 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:40.142626 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-386c87cf-de13-4f00-856e-f25473031a52 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:40.143399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-386c87cf-de13-4f00-856e-f25473031a52 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:40.144028 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-386c87cf-de13-4f00-856e-f25473031a52 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:40.304761 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-386c87cf-de13-4f00-856e-f25473031a52 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:40.313577 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-386c87cf-de13-4f00-856e-f25473031a52 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1677 microversion: 2.1 time: 0.183817 Jul 20 15:35:40.320214 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 209/419] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:40 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1677 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:40.638584 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5e51a7be-a6a8-4466-8fa5-65b4c9a61054 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:40.639372 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5e51a7be-a6a8-4466-8fa5-65b4c9a61054 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:40.647596 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e51a7be-a6a8-4466-8fa5-65b4c9a61054 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:40.648475 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e51a7be-a6a8-4466-8fa5-65b4c9a61054 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:40.649431 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e51a7be-a6a8-4466-8fa5-65b4c9a61054 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:40.650061 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e51a7be-a6a8-4466-8fa5-65b4c9a61054 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:40.776407 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=2 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:40.820350 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=6 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:40.848462 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-2234bcd8-9e1b-476e-900b-a8bd2f525fa4 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:40.849798 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-2234bcd8-9e1b-476e-900b-a8bd2f525fa4 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:40.858458 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2234bcd8-9e1b-476e-900b-a8bd2f525fa4 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:40.859294 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2234bcd8-9e1b-476e-900b-a8bd2f525fa4 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:40.860424 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2234bcd8-9e1b-476e-900b-a8bd2f525fa4 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:40.861075 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2234bcd8-9e1b-476e-900b-a8bd2f525fa4 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:40.868958 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5e51a7be-a6a8-4466-8fa5-65b4c9a61054 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:40.888284 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5e51a7be-a6a8-4466-8fa5-65b4c9a61054 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:40.898446 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5e51a7be-a6a8-4466-8fa5-65b4c9a61054 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:40.900104 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5e51a7be-a6a8-4466-8fa5-65b4c9a61054 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1807 microversion: 2.20 time: 0.265535 Jul 20 15:35:40.907805 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 211/420] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:40 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1807 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:41.050718 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-2234bcd8-9e1b-476e-900b-a8bd2f525fa4 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:41.060784 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-2234bcd8-9e1b-476e-900b-a8bd2f525fa4 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 200 len: 1319 microversion: 2.1 time: 0.216489 Jul 20 15:35:41.061376 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 210/421] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:40 2022] GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:35:41.332529 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-7bce2d73-9481-4927-85d3-2577a533426d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:41.334415 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-7bce2d73-9481-4927-85d3-2577a533426d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:41.339944 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7bce2d73-9481-4927-85d3-2577a533426d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:41.340392 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7bce2d73-9481-4927-85d3-2577a533426d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:41.341164 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7bce2d73-9481-4927-85d3-2577a533426d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:41.341629 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7bce2d73-9481-4927-85d3-2577a533426d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:41.423989 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-59c6231f-825d-4779-b4d6-c92bfd59de92 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Action: 'create', calling method: .version_select at 0x7efd90afc8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-419272811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLa4pUZVlJ8J3vXBskP3M0bD7gWV/4LgkzOIMV2BLCYjaSq3pZ1FLVO9yvkbZuDVjK8XmOVRXywnMwGGLFutxSJneXiFUErj0dOQJ/0S0hsBg0XZxoU3ptowjE4iuqZpgg=="}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:35:41.442940 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-59c6231f-825d-4779-b4d6-c92bfd59de92 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Getting quotas for project 09d92d320f8748c58aca3fd6a8776540. Resources: {'key_pairs'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:35:41.450420 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-59c6231f-825d-4779-b4d6-c92bfd59de92 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Getting quotas for user ec2e023235a343dd81754211ee102f3c and project 09d92d320f8748c58aca3fd6a8776540. Resources: {'key_pairs'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:35:41.494017 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-7bce2d73-9481-4927-85d3-2577a533426d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:41.502314 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-7bce2d73-9481-4927-85d3-2577a533426d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1677 microversion: 2.1 time: 0.173710 Jul 20 15:35:41.502843 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 211/422] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:41 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:35:41.558779 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-59c6231f-825d-4779-b4d6-c92bfd59de92 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.333690 Jul 20 15:35:41.559362 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 212/423] 10.222.0.78 () {60 vars in 1158 bytes} [Wed Jul 20 15:35:41 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:35:41.922713 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-95bb24f0-079d-4bc2-9658-9b99b16a36ed tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:41.924456 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-95bb24f0-079d-4bc2-9658-9b99b16a36ed tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:41.933059 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-95bb24f0-079d-4bc2-9658-9b99b16a36ed tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:41.933820 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-95bb24f0-079d-4bc2-9658-9b99b16a36ed tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:41.934845 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-95bb24f0-079d-4bc2-9658-9b99b16a36ed tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:41.935578 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-95bb24f0-079d-4bc2-9658-9b99b16a36ed tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:42.079969 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-8a2993c4-e866-41d1-9498-3f702adcfc72 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:42.080935 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-8a2993c4-e866-41d1-9498-3f702adcfc72 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:42.092772 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-95bb24f0-079d-4bc2-9658-9b99b16a36ed tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:42.099287 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8a2993c4-e866-41d1-9498-3f702adcfc72 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:42.103294 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8a2993c4-e866-41d1-9498-3f702adcfc72 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:42.103294 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8a2993c4-e866-41d1-9498-3f702adcfc72 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:42.103294 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8a2993c4-e866-41d1-9498-3f702adcfc72 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:42.103559 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-95bb24f0-079d-4bc2-9658-9b99b16a36ed tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:42.104073 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-95bb24f0-079d-4bc2-9658-9b99b16a36ed tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:42.105939 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-95bb24f0-079d-4bc2-9658-9b99b16a36ed tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1807 microversion: 2.20 time: 0.190344 Jul 20 15:35:42.117063 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 212/424] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:41 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1807 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:42.267432 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-8a2993c4-e866-41d1-9498-3f702adcfc72 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:42.276331 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-8a2993c4-e866-41d1-9498-3f702adcfc72 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 200 len: 1319 microversion: 2.1 time: 0.200511 Jul 20 15:35:42.277894 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 213/425] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:42 2022] GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:35:42.520581 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b5b77162-ce6c-4553-9424-b08522008e67 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:42.521263 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b5b77162-ce6c-4553-9424-b08522008e67 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:42.527653 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b5b77162-ce6c-4553-9424-b08522008e67 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:42.528097 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b5b77162-ce6c-4553-9424-b08522008e67 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:42.528860 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b5b77162-ce6c-4553-9424-b08522008e67 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:42.529288 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b5b77162-ce6c-4553-9424-b08522008e67 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:42.726113 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b5b77162-ce6c-4553-9424-b08522008e67 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:42.740273 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b5b77162-ce6c-4553-9424-b08522008e67 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1677 microversion: 2.1 time: 0.219158 Jul 20 15:35:42.746146 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 213/426] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:42 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1677 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:43.069104 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-8cc4d574-794f-466a-a780-5be3046783c1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:35:43.070118 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-8cc4d574-794f-466a-a780-5be3046783c1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:43.089006 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8cc4d574-794f-466a-a780-5be3046783c1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:43.093111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8cc4d574-794f-466a-a780-5be3046783c1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:43.097791 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8cc4d574-794f-466a-a780-5be3046783c1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:43.098682 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8cc4d574-794f-466a-a780-5be3046783c1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:43.126769 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-f7dfe321-f2b5-499a-a1bb-de7096ebd927 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:43.131699 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-f7dfe321-f2b5-499a-a1bb-de7096ebd927 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:43.131699 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=4 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:43.142945 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f7dfe321-f2b5-499a-a1bb-de7096ebd927 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:43.148869 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f7dfe321-f2b5-499a-a1bb-de7096ebd927 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:43.149894 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f7dfe321-f2b5-499a-a1bb-de7096ebd927 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:43.152681 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f7dfe321-f2b5-499a-a1bb-de7096ebd927 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:43.211359 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.objects.instance [None req-8cc4d574-794f-466a-a780-5be3046783c1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lazy-loading 'flavor' on Instance uuid 91beb453-6320-472a-951c-3fda16747994 {{(pid=124711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:35:43.486080 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-f7dfe321-f2b5-499a-a1bb-de7096ebd927 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:43.488661 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=100 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:43.501672 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-f7dfe321-f2b5-499a-a1bb-de7096ebd927 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:43.503246 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-f7dfe321-f2b5-499a-a1bb-de7096ebd927 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:43.504422 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-f7dfe321-f2b5-499a-a1bb-de7096ebd927 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1807 microversion: 2.20 time: 0.382876 Jul 20 15:35:43.511782 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 214/427] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:43 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1807 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:35:43.525602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-8e28c182-7296-4b1b-a815-317560ce7ed2 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:43.531170 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-8e28c182-7296-4b1b-a815-317560ce7ed2 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:43.538399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8e28c182-7296-4b1b-a815-317560ce7ed2 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:43.539966 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8e28c182-7296-4b1b-a815-317560ce7ed2 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:43.540928 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8e28c182-7296-4b1b-a815-317560ce7ed2 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:43.541523 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8e28c182-7296-4b1b-a815-317560ce7ed2 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:43.744244 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-8cc4d574-794f-466a-a780-5be3046783c1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "POST /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994/action" status: 200 len: 32 microversion: 2.1 time: 0.678853 Jul 20 15:35:43.746318 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 214/428] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Jul 20 15:35:43 2022] POST /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994/action => generated 32 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 15:35:43.772822 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e7009d6b-8cda-4c8d-a8b4-e9cd2ce6b93a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:43.773626 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e7009d6b-8cda-4c8d-a8b4-e9cd2ce6b93a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:43.786979 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e7009d6b-8cda-4c8d-a8b4-e9cd2ce6b93a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:43.787737 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e7009d6b-8cda-4c8d-a8b4-e9cd2ce6b93a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:43.788703 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e7009d6b-8cda-4c8d-a8b4-e9cd2ce6b93a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:43.789725 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e7009d6b-8cda-4c8d-a8b4-e9cd2ce6b93a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:43.827559 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-8e28c182-7296-4b1b-a815-317560ce7ed2 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:43.837234 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-8e28c182-7296-4b1b-a815-317560ce7ed2 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 200 len: 1319 microversion: 2.1 time: 0.323047 Jul 20 15:35:43.844278 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 215/429] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:43 2022] GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:43.850062 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-3061070b-33a4-4f0f-93b6-4a00b863c9b6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:43.851052 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-3061070b-33a4-4f0f-93b6-4a00b863c9b6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:43.858385 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3061070b-33a4-4f0f-93b6-4a00b863c9b6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:43.859312 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3061070b-33a4-4f0f-93b6-4a00b863c9b6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:43.860287 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3061070b-33a4-4f0f-93b6-4a00b863c9b6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:43.861048 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3061070b-33a4-4f0f-93b6-4a00b863c9b6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:44.098484 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e7009d6b-8cda-4c8d-a8b4-e9cd2ce6b93a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:44.109852 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e7009d6b-8cda-4c8d-a8b4-e9cd2ce6b93a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1677 microversion: 2.1 time: 0.360473 Jul 20 15:35:44.111341 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 215/430] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:43 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1677 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:44.165337 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-3061070b-33a4-4f0f-93b6-4a00b863c9b6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:44.179622 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-3061070b-33a4-4f0f-93b6-4a00b863c9b6 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1731 microversion: 2.1 time: 0.334012 Jul 20 15:35:44.181401 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 216/431] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:43 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1731 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:44.527032 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-3b96935b-501b-4baf-aa5f-8ce635bda0e6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:44.527959 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-3b96935b-501b-4baf-aa5f-8ce635bda0e6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:44.535192 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3b96935b-501b-4baf-aa5f-8ce635bda0e6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:44.535655 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3b96935b-501b-4baf-aa5f-8ce635bda0e6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:44.536665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3b96935b-501b-4baf-aa5f-8ce635bda0e6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:44.537101 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3b96935b-501b-4baf-aa5f-8ce635bda0e6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:44.554805 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:44.687362 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-3b96935b-501b-4baf-aa5f-8ce635bda0e6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:44.696264 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-3b96935b-501b-4baf-aa5f-8ce635bda0e6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:44.697792 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-3b96935b-501b-4baf-aa5f-8ce635bda0e6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:44.699237 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-3b96935b-501b-4baf-aa5f-8ce635bda0e6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1807 microversion: 2.20 time: 0.175935 Jul 20 15:35:44.699990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 216/432] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:44 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:44.856852 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-8d0c551d-c5ad-4deb-8d2e-eaabcb13bc02 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:44.857139 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-8d0c551d-c5ad-4deb-8d2e-eaabcb13bc02 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:44.863358 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8d0c551d-c5ad-4deb-8d2e-eaabcb13bc02 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:44.863805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8d0c551d-c5ad-4deb-8d2e-eaabcb13bc02 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:44.864577 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8d0c551d-c5ad-4deb-8d2e-eaabcb13bc02 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:44.865013 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8d0c551d-c5ad-4deb-8d2e-eaabcb13bc02 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:45.011984 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=2 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:45.035355 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-8d0c551d-c5ad-4deb-8d2e-eaabcb13bc02 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:45.048260 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-8d0c551d-c5ad-4deb-8d2e-eaabcb13bc02 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 200 len: 1319 microversion: 2.1 time: 0.196394 Jul 20 15:35:45.049298 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 217/433] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:44 2022] GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:45.129526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-bdf7b4f1-bf58-4969-9d38-352903856377 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:45.130454 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-bdf7b4f1-bf58-4969-9d38-352903856377 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:45.138055 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bdf7b4f1-bf58-4969-9d38-352903856377 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:45.138547 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bdf7b4f1-bf58-4969-9d38-352903856377 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:45.139328 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bdf7b4f1-bf58-4969-9d38-352903856377 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:45.139761 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bdf7b4f1-bf58-4969-9d38-352903856377 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:45.199473 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d8c8b196-e252-401f-96dc-9d7226b9ced4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:45.200663 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d8c8b196-e252-401f-96dc-9d7226b9ced4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:45.215758 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d8c8b196-e252-401f-96dc-9d7226b9ced4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:45.216117 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d8c8b196-e252-401f-96dc-9d7226b9ced4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:45.217087 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d8c8b196-e252-401f-96dc-9d7226b9ced4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:45.217631 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d8c8b196-e252-401f-96dc-9d7226b9ced4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:45.381934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-bdf7b4f1-bf58-4969-9d38-352903856377 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:45.390816 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-bdf7b4f1-bf58-4969-9d38-352903856377 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1654 microversion: 2.1 time: 0.265995 Jul 20 15:35:45.411303 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 217/434] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:45 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1654 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:35:45.411303 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-4a186436-deca-4dcb-adb5-dc311b363078 req-ba165dee-7df3-424e-b7c2-6dd04224c3e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4cd0f35-70ba-409d-b217-32d5a9ab6cd6", "name": "network-vif-plugged", "status": "completed", "tag": "59e14bde-8d7e-43e1-8cdf-acd276b65784"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:35:45.411303 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-4a186436-deca-4dcb-adb5-dc311b363078 req-ba165dee-7df3-424e-b7c2-6dd04224c3e5 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:45.411303 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-4a186436-deca-4dcb-adb5-dc311b363078 req-ba165dee-7df3-424e-b7c2-6dd04224c3e5 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:45.419206 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d8c8b196-e252-401f-96dc-9d7226b9ced4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:45.422084 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-4a186436-deca-4dcb-adb5-dc311b363078 req-ba165dee-7df3-424e-b7c2-6dd04224c3e5 service nova] Creating event network-vif-plugged:59e14bde-8d7e-43e1-8cdf-acd276b65784 for instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 on hv-cinder-81914 Jul 20 15:35:45.427103 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-4a186436-deca-4dcb-adb5-dc311b363078 req-ba165dee-7df3-424e-b7c2-6dd04224c3e5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034530 Jul 20 15:35:45.427330 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-d8c8b196-e252-401f-96dc-9d7226b9ced4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1731 microversion: 2.1 time: 0.232631 Jul 20 15:35:45.427718 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 218/435] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:35:45.427869 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 218/436] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:45 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1731 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:35:45.432982 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-a0b85cf6-192d-4838-a495-b05670e71a11 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:35:45.440384 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a0b85cf6-192d-4838-a495-b05670e71a11 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:45.441028 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a0b85cf6-192d-4838-a495-b05670e71a11 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:45.524767 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-a0b85cf6-192d-4838-a495-b05670e71a11 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Going to try to start instance {{(pid=124711) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 15:35:45.717585 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-46f7cadf-340e-4de7-afc6-88525caa0999 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:45.718203 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-46f7cadf-340e-4de7-afc6-88525caa0999 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:45.725261 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-46f7cadf-340e-4de7-afc6-88525caa0999 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:45.725703 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-46f7cadf-340e-4de7-afc6-88525caa0999 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:45.726488 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-46f7cadf-340e-4de7-afc6-88525caa0999 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:45.727101 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-46f7cadf-340e-4de7-afc6-88525caa0999 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:45.776190 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-a0b85cf6-192d-4838-a495-b05670e71a11 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "POST /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a/action" status: 202 len: 0 microversion: 2.1 time: 0.347043 Jul 20 15:35:45.776840 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 219/437] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Jul 20 15:35:45 2022] POST /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:35:45.787283 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-9506d04a-5102-4af5-b56f-d1deac669c36 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:45.787994 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-9506d04a-5102-4af5-b56f-d1deac669c36 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:45.802531 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9506d04a-5102-4af5-b56f-d1deac669c36 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:45.802531 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9506d04a-5102-4af5-b56f-d1deac669c36 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:45.803211 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9506d04a-5102-4af5-b56f-d1deac669c36 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:45.803644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9506d04a-5102-4af5-b56f-d1deac669c36 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:45.960219 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-46f7cadf-340e-4de7-afc6-88525caa0999 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:45.976595 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-46f7cadf-340e-4de7-afc6-88525caa0999 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:45.981481 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-46f7cadf-340e-4de7-afc6-88525caa0999 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:45.981481 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-46f7cadf-340e-4de7-afc6-88525caa0999 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1807 microversion: 2.20 time: 0.266980 Jul 20 15:35:45.981481 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 219/438] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:45 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1807 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:46.034092 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-9506d04a-5102-4af5-b56f-d1deac669c36 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:46.041744 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-9506d04a-5102-4af5-b56f-d1deac669c36 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1663 microversion: 2.1 time: 0.258823 Jul 20 15:35:46.043056 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 220/439] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:45 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1663 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:46.068961 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-70dece0c-8abc-4e09-af8a-b1a47665e71a tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:46.070080 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-70dece0c-8abc-4e09-af8a-b1a47665e71a tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:46.080993 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-70dece0c-8abc-4e09-af8a-b1a47665e71a tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:46.081764 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-70dece0c-8abc-4e09-af8a-b1a47665e71a tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:46.084076 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-70dece0c-8abc-4e09-af8a-b1a47665e71a tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:46.084846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-70dece0c-8abc-4e09-af8a-b1a47665e71a tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:46.232684 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-70dece0c-8abc-4e09-af8a-b1a47665e71a tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:46.241013 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-70dece0c-8abc-4e09-af8a-b1a47665e71a tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 200 len: 1319 microversion: 2.1 time: 0.179017 Jul 20 15:35:46.252801 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 220/440] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:46 2022] GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:46.446397 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-50337c94-1374-4160-9457-c5f6c6a0660b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:46.447061 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-50337c94-1374-4160-9457-c5f6c6a0660b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:46.453702 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-50337c94-1374-4160-9457-c5f6c6a0660b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:46.458428 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-50337c94-1374-4160-9457-c5f6c6a0660b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:46.458428 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-50337c94-1374-4160-9457-c5f6c6a0660b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:46.458428 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-50337c94-1374-4160-9457-c5f6c6a0660b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:46.587472 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-50337c94-1374-4160-9457-c5f6c6a0660b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:46.595854 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-50337c94-1374-4160-9457-c5f6c6a0660b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1731 microversion: 2.1 time: 0.153780 Jul 20 15:35:46.596420 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 221/441] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:46 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:47.009953 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-fadf98ba-fedd-44cd-b0fb-5f092ed2c4fb tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:47.011461 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-fadf98ba-fedd-44cd-b0fb-5f092ed2c4fb tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:47.017804 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fadf98ba-fedd-44cd-b0fb-5f092ed2c4fb tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:47.018254 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fadf98ba-fedd-44cd-b0fb-5f092ed2c4fb tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:47.019051 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fadf98ba-fedd-44cd-b0fb-5f092ed2c4fb tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:47.019480 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fadf98ba-fedd-44cd-b0fb-5f092ed2c4fb tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:47.067648 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-f2154a21-67a0-4377-96fd-f2f8ed485619 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:47.068264 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-f2154a21-67a0-4377-96fd-f2f8ed485619 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:47.074578 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f2154a21-67a0-4377-96fd-f2f8ed485619 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:47.075029 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f2154a21-67a0-4377-96fd-f2f8ed485619 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:47.075798 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f2154a21-67a0-4377-96fd-f2f8ed485619 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:47.076269 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f2154a21-67a0-4377-96fd-f2f8ed485619 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:47.219791 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-fadf98ba-fedd-44cd-b0fb-5f092ed2c4fb tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:47.239501 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-fadf98ba-fedd-44cd-b0fb-5f092ed2c4fb tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:47.241023 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-fadf98ba-fedd-44cd-b0fb-5f092ed2c4fb tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:47.242904 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-fadf98ba-fedd-44cd-b0fb-5f092ed2c4fb tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1807 microversion: 2.20 time: 0.236841 Jul 20 15:35:47.253598 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-f2154a21-67a0-4377-96fd-f2f8ed485619 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:47.255287 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 221/442] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:47 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1807 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:35:47.260052 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-52917430-c6e7-4dfd-82ab-bb4ece04b173 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:47.262292 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-52917430-c6e7-4dfd-82ab-bb4ece04b173 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:47.262631 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-f2154a21-67a0-4377-96fd-f2f8ed485619 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1663 microversion: 2.1 time: 0.197400 Jul 20 15:35:47.262631 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 222/443] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:47 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1663 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:35:47.267110 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-52917430-c6e7-4dfd-82ab-bb4ece04b173 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:47.267704 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-52917430-c6e7-4dfd-82ab-bb4ece04b173 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:47.268480 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-52917430-c6e7-4dfd-82ab-bb4ece04b173 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:47.268912 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-52917430-c6e7-4dfd-82ab-bb4ece04b173 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:47.416516 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-52917430-c6e7-4dfd-82ab-bb4ece04b173 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:47.424774 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-52917430-c6e7-4dfd-82ab-bb4ece04b173 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 200 len: 1319 microversion: 2.1 time: 0.168503 Jul 20 15:35:47.425462 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 222/444] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:47 2022] GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:47.454792 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-9843d7b0-0ac8-44df-acb7-b492ce38b767 req-c6c9c6c6-d5fc-4a1c-9384-27bb48a10a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6854fb03-c976-4d6f-88ff-8060777c67bc", "name": "network-vif-plugged", "status": "completed", "tag": "5ea8bb63-cd9c-4e67-8488-ff3991760128"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:35:47.462576 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-9843d7b0-0ac8-44df-acb7-b492ce38b767 req-c6c9c6c6-d5fc-4a1c-9384-27bb48a10a8a service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:47.463010 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-9843d7b0-0ac8-44df-acb7-b492ce38b767 req-c6c9c6c6-d5fc-4a1c-9384-27bb48a10a8a service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:47.478536 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-9843d7b0-0ac8-44df-acb7-b492ce38b767 req-c6c9c6c6-d5fc-4a1c-9384-27bb48a10a8a service nova] Creating event network-vif-plugged:5ea8bb63-cd9c-4e67-8488-ff3991760128 for instance 6854fb03-c976-4d6f-88ff-8060777c67bc on hv-cinder-81914 Jul 20 15:35:47.489476 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-9843d7b0-0ac8-44df-acb7-b492ce38b767 req-c6c9c6c6-d5fc-4a1c-9384-27bb48a10a8a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038502 Jul 20 15:35:47.492568 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 223/445] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:35:47.613844 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-fd40bf39-d4c3-4286-b86b-021385768e25 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:47.614442 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-fd40bf39-d4c3-4286-b86b-021385768e25 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:47.621185 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fd40bf39-d4c3-4286-b86b-021385768e25 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:47.621627 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fd40bf39-d4c3-4286-b86b-021385768e25 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:47.622482 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fd40bf39-d4c3-4286-b86b-021385768e25 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:47.622912 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fd40bf39-d4c3-4286-b86b-021385768e25 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:47.785546 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-fd40bf39-d4c3-4286-b86b-021385768e25 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:47.790185 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-fd40bf39-d4c3-4286-b86b-021385768e25 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1731 microversion: 2.1 time: 0.180980 Jul 20 15:35:47.790796 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 223/446] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:47 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1731 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:48.263019 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-cff9a82c-2d77-469f-a1dc-bb9fe1d6a808 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:48.263748 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-cff9a82c-2d77-469f-a1dc-bb9fe1d6a808 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:48.271109 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cff9a82c-2d77-469f-a1dc-bb9fe1d6a808 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:48.271561 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cff9a82c-2d77-469f-a1dc-bb9fe1d6a808 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:48.272457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cff9a82c-2d77-469f-a1dc-bb9fe1d6a808 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:48.272837 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cff9a82c-2d77-469f-a1dc-bb9fe1d6a808 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:48.280702 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-17bef614-3c12-495f-9d68-8c79a3a681a9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:48.316436 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-17bef614-3c12-495f-9d68-8c79a3a681a9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:48.316436 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-17bef614-3c12-495f-9d68-8c79a3a681a9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:48.316436 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-17bef614-3c12-495f-9d68-8c79a3a681a9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:48.316436 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-17bef614-3c12-495f-9d68-8c79a3a681a9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:48.317701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-17bef614-3c12-495f-9d68-8c79a3a681a9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:48.639763 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-cff9a82c-2d77-469f-a1dc-bb9fe1d6a808 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:48.639763 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-cff9a82c-2d77-469f-a1dc-bb9fe1d6a808 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:48.640688 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-cff9a82c-2d77-469f-a1dc-bb9fe1d6a808 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:48.640688 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-cff9a82c-2d77-469f-a1dc-bb9fe1d6a808 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1807 microversion: 2.20 time: 0.246972 Jul 20 15:35:48.640688 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 224/447] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:48 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1807 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:35:48.640688 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-beb3b423-4cfc-4266-8419-c8e5a44ac229 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:48.641073 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-17bef614-3c12-495f-9d68-8c79a3a681a9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:48.641187 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-beb3b423-4cfc-4266-8419-c8e5a44ac229 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:48.641187 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-beb3b423-4cfc-4266-8419-c8e5a44ac229 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:48.641187 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-beb3b423-4cfc-4266-8419-c8e5a44ac229 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:48.641187 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-beb3b423-4cfc-4266-8419-c8e5a44ac229 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:48.641487 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-beb3b423-4cfc-4266-8419-c8e5a44ac229 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:48.641572 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-17bef614-3c12-495f-9d68-8c79a3a681a9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1663 microversion: 2.1 time: 0.249224 Jul 20 15:35:48.641572 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 224/448] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:48 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1663 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:35:48.686133 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-beb3b423-4cfc-4266-8419-c8e5a44ac229 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:48.699949 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-beb3b423-4cfc-4266-8419-c8e5a44ac229 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 200 len: 1319 microversion: 2.1 time: 0.192738 Jul 20 15:35:48.700638 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 225/449] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:48 2022] GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:48.809514 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-addc66d2-a656-4989-8f8d-fa2e860430a4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:48.810301 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-addc66d2-a656-4989-8f8d-fa2e860430a4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:48.817395 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-addc66d2-a656-4989-8f8d-fa2e860430a4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:48.817848 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-addc66d2-a656-4989-8f8d-fa2e860430a4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:48.819492 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-addc66d2-a656-4989-8f8d-fa2e860430a4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:48.819981 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-addc66d2-a656-4989-8f8d-fa2e860430a4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:48.971537 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-addc66d2-a656-4989-8f8d-fa2e860430a4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:48.980261 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-addc66d2-a656-4989-8f8d-fa2e860430a4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1731 microversion: 2.1 time: 0.175247 Jul 20 15:35:48.980845 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 225/450] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:48 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:49.657168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-3094ecfc-9fd8-46fa-975d-742916f5f5da tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:49.658540 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-3094ecfc-9fd8-46fa-975d-742916f5f5da tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:49.663360 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-dad3f438-e7c6-41eb-9ce6-364fe367bab3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:49.664446 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-dad3f438-e7c6-41eb-9ce6-364fe367bab3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:49.665811 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3094ecfc-9fd8-46fa-975d-742916f5f5da tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:49.666347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3094ecfc-9fd8-46fa-975d-742916f5f5da tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:49.667747 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3094ecfc-9fd8-46fa-975d-742916f5f5da tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:49.668373 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3094ecfc-9fd8-46fa-975d-742916f5f5da tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:49.675162 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dad3f438-e7c6-41eb-9ce6-364fe367bab3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:49.675914 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dad3f438-e7c6-41eb-9ce6-364fe367bab3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:49.677172 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dad3f438-e7c6-41eb-9ce6-364fe367bab3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:49.677875 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dad3f438-e7c6-41eb-9ce6-364fe367bab3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:49.911631 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-3094ecfc-9fd8-46fa-975d-742916f5f5da tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:49.919030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-dad3f438-e7c6-41eb-9ce6-364fe367bab3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:49.919212 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-3094ecfc-9fd8-46fa-975d-742916f5f5da tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1667 microversion: 2.1 time: 0.266231 Jul 20 15:35:49.919837 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 226/451] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:49 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1667 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:49.924410 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e50f6125-5632-4b7e-8553-c77820198f1b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:49.925009 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e50f6125-5632-4b7e-8553-c77820198f1b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:49.929169 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-dad3f438-e7c6-41eb-9ce6-364fe367bab3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:49.931273 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-dad3f438-e7c6-41eb-9ce6-364fe367bab3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:49.932515 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-dad3f438-e7c6-41eb-9ce6-364fe367bab3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1807 microversion: 2.20 time: 0.275779 Jul 20 15:35:49.932942 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e50f6125-5632-4b7e-8553-c77820198f1b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:49.933399 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e50f6125-5632-4b7e-8553-c77820198f1b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:49.934153 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e50f6125-5632-4b7e-8553-c77820198f1b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:49.934838 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e50f6125-5632-4b7e-8553-c77820198f1b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:49.937759 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 226/452] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:49 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1807 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:50.000718 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d146183a-8a64-425f-b7ae-3bc8a6f4ac80 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:50.001420 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d146183a-8a64-425f-b7ae-3bc8a6f4ac80 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:50.008536 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d146183a-8a64-425f-b7ae-3bc8a6f4ac80 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:50.008982 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d146183a-8a64-425f-b7ae-3bc8a6f4ac80 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:50.009948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d146183a-8a64-425f-b7ae-3bc8a6f4ac80 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:50.010206 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d146183a-8a64-425f-b7ae-3bc8a6f4ac80 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:50.150802 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e50f6125-5632-4b7e-8553-c77820198f1b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:50.159088 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e50f6125-5632-4b7e-8553-c77820198f1b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 200 len: 1319 microversion: 2.1 time: 0.238245 Jul 20 15:35:50.159712 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 227/453] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:49 2022] GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:50.189392 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d146183a-8a64-425f-b7ae-3bc8a6f4ac80 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:50.199013 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-d146183a-8a64-425f-b7ae-3bc8a6f4ac80 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1731 microversion: 2.1 time: 0.202358 Jul 20 15:35:50.199587 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 227/454] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:49 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:50.953069 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-00b7d678-fd56-4865-95e1-53f96c2fc8e2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:50.953768 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-00b7d678-fd56-4865-95e1-53f96c2fc8e2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:50.956239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:50.961237 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-00b7d678-fd56-4865-95e1-53f96c2fc8e2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:50.961734 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-00b7d678-fd56-4865-95e1-53f96c2fc8e2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:50.962521 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-00b7d678-fd56-4865-95e1-53f96c2fc8e2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:50.962960 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-00b7d678-fd56-4865-95e1-53f96c2fc8e2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:51.107055 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-00b7d678-fd56-4865-95e1-53f96c2fc8e2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:51.115559 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-00b7d678-fd56-4865-95e1-53f96c2fc8e2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:51.117083 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-00b7d678-fd56-4865-95e1-53f96c2fc8e2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:51.118240 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-00b7d678-fd56-4865-95e1-53f96c2fc8e2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1794 microversion: 2.20 time: 0.169654 Jul 20 15:35:51.118829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 228/455] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:35:50 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1794 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:35:51.176443 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-63e2751d-5a13-495f-b641-094535ace3dc tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:51.177056 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-63e2751d-5a13-495f-b641-094535ace3dc tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:51.183689 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-63e2751d-5a13-495f-b641-094535ace3dc tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:51.184142 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-63e2751d-5a13-495f-b641-094535ace3dc tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:51.185029 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-63e2751d-5a13-495f-b641-094535ace3dc tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:51.185465 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-63e2751d-5a13-495f-b641-094535ace3dc tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:51.216875 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-2e46a6b9-a728-46a9-87b9-6642b3f72c1d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:51.217483 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-2e46a6b9-a728-46a9-87b9-6642b3f72c1d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:51.223528 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2e46a6b9-a728-46a9-87b9-6642b3f72c1d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:51.223965 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2e46a6b9-a728-46a9-87b9-6642b3f72c1d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:51.224724 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2e46a6b9-a728-46a9-87b9-6642b3f72c1d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:51.225158 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2e46a6b9-a728-46a9-87b9-6642b3f72c1d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:51.384100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-63e2751d-5a13-495f-b641-094535ace3dc tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:51.392950 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-63e2751d-5a13-495f-b641-094535ace3dc tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 200 len: 1319 microversion: 2.1 time: 0.219736 Jul 20 15:35:51.392950 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 228/456] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:51 2022] GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:51.407940 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2e46a6b9-a728-46a9-87b9-6642b3f72c1d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:51.416328 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-2e46a6b9-a728-46a9-87b9-6642b3f72c1d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1731 microversion: 2.1 time: 0.203648 Jul 20 15:35:51.426053 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 229/457] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:51 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:35:52.409350 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-47abacb2-3761-4066-8d6e-bbedaa85c360 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:52.409937 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-47abacb2-3761-4066-8d6e-bbedaa85c360 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:52.416518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-47abacb2-3761-4066-8d6e-bbedaa85c360 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:52.417637 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-47abacb2-3761-4066-8d6e-bbedaa85c360 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:52.418466 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-47abacb2-3761-4066-8d6e-bbedaa85c360 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:52.418900 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-47abacb2-3761-4066-8d6e-bbedaa85c360 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:52.443996 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-52d5adda-cf43-48a9-b10e-1d95f7040fd7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:52.444937 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-52d5adda-cf43-48a9-b10e-1d95f7040fd7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:52.446881 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=4 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:52.453160 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-52d5adda-cf43-48a9-b10e-1d95f7040fd7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:52.453604 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-52d5adda-cf43-48a9-b10e-1d95f7040fd7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:52.454381 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-52d5adda-cf43-48a9-b10e-1d95f7040fd7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:52.454962 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-52d5adda-cf43-48a9-b10e-1d95f7040fd7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:52.634247 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-47abacb2-3761-4066-8d6e-bbedaa85c360 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:52.638854 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-52d5adda-cf43-48a9-b10e-1d95f7040fd7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:52.642638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-47abacb2-3761-4066-8d6e-bbedaa85c360 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 200 len: 1508 microversion: 2.1 time: 0.237206 Jul 20 15:35:52.643213 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 229/458] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:52 2022] GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 1508 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:52.647595 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-52d5adda-cf43-48a9-b10e-1d95f7040fd7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1731 microversion: 2.1 time: 0.207689 Jul 20 15:35:52.648290 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 230/459] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:52 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1731 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:35:53.276746 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-0e290345-2205-4449-a88f-0414c41949b7 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:53.277454 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-0e290345-2205-4449-a88f-0414c41949b7 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:53.283549 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0e290345-2205-4449-a88f-0414c41949b7 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:53.283994 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0e290345-2205-4449-a88f-0414c41949b7 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:53.284799 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0e290345-2205-4449-a88f-0414c41949b7 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:53.285243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0e290345-2205-4449-a88f-0414c41949b7 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:53.436945 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-0e290345-2205-4449-a88f-0414c41949b7 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:53.446218 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-0e290345-2205-4449-a88f-0414c41949b7 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1595 microversion: 2.1 time: 0.173303 Jul 20 15:35:53.446828 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 230/460] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:53 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1595 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:53.669670 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-86772f95-03dd-4761-be14-cf95a08512c1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:53.670902 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-86772f95-03dd-4761-be14-cf95a08512c1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:53.678487 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-86772f95-03dd-4761-be14-cf95a08512c1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:53.679088 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-86772f95-03dd-4761-be14-cf95a08512c1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:53.680071 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-86772f95-03dd-4761-be14-cf95a08512c1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:53.680505 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-86772f95-03dd-4761-be14-cf95a08512c1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:53.894426 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-86772f95-03dd-4761-be14-cf95a08512c1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:53.903200 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-86772f95-03dd-4761-be14-cf95a08512c1 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1731 microversion: 2.1 time: 0.241418 Jul 20 15:35:53.903855 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 231/461] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:53 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1731 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:54.921678 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-16ee7b67-a5c8-42d4-86b7-3e0efa3b7278 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:54.922440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-16ee7b67-a5c8-42d4-86b7-3e0efa3b7278 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:54.930050 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-16ee7b67-a5c8-42d4-86b7-3e0efa3b7278 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:54.930602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-16ee7b67-a5c8-42d4-86b7-3e0efa3b7278 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:54.931517 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-16ee7b67-a5c8-42d4-86b7-3e0efa3b7278 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:54.932023 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-16ee7b67-a5c8-42d4-86b7-3e0efa3b7278 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:54.949727 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=100 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:55.401180 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-16ee7b67-a5c8-42d4-86b7-3e0efa3b7278 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:55.410099 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-16ee7b67-a5c8-42d4-86b7-3e0efa3b7278 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1731 microversion: 2.1 time: 0.492971 Jul 20 15:35:55.410723 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 231/462] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:54 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1731 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:56.216556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-7eaed2db-f243-4268-880d-00b15bc3d3df req-55606929-f091-441b-bb22-84fcf18a6dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "170181c4-a3e8-494d-bef6-2048dd9b0257", "tag": "3f4230e5-b6b6-43aa-985b-67a345eed1aa"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:35:56.226015 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-7eaed2db-f243-4268-880d-00b15bc3d3df req-55606929-f091-441b-bb22-84fcf18a6dd0 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:56.226612 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-7eaed2db-f243-4268-880d-00b15bc3d3df req-55606929-f091-441b-bb22-84fcf18a6dd0 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:56.239966 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-7eaed2db-f243-4268-880d-00b15bc3d3df req-55606929-f091-441b-bb22-84fcf18a6dd0 service nova] Creating event network-changed:3f4230e5-b6b6-43aa-985b-67a345eed1aa for instance 170181c4-a3e8-494d-bef6-2048dd9b0257 on hv-cinder-81914 Jul 20 15:35:56.245609 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-7eaed2db-f243-4268-880d-00b15bc3d3df req-55606929-f091-441b-bb22-84fcf18a6dd0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032349 Jul 20 15:35:56.246218 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 232/463] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:35:56.434472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-4ae2b043-a6a6-4f6d-ac76-f69157372ee7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:56.435616 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-4ae2b043-a6a6-4f6d-ac76-f69157372ee7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:56.442834 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4ae2b043-a6a6-4f6d-ac76-f69157372ee7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:56.444116 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4ae2b043-a6a6-4f6d-ac76-f69157372ee7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:56.445072 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4ae2b043-a6a6-4f6d-ac76-f69157372ee7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:56.445902 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4ae2b043-a6a6-4f6d-ac76-f69157372ee7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:56.614427 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4ae2b043-a6a6-4f6d-ac76-f69157372ee7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:56.623362 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-4ae2b043-a6a6-4f6d-ac76-f69157372ee7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1731 microversion: 2.1 time: 0.196401 Jul 20 15:35:56.624177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 232/464] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:56 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:35:57.663007 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-cce74a1c-21b4-4be9-b6cb-a2baa500d01d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:57.664345 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-cce74a1c-21b4-4be9-b6cb-a2baa500d01d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:57.675144 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cce74a1c-21b4-4be9-b6cb-a2baa500d01d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:57.675700 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cce74a1c-21b4-4be9-b6cb-a2baa500d01d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:57.676670 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cce74a1c-21b4-4be9-b6cb-a2baa500d01d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:57.677247 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cce74a1c-21b4-4be9-b6cb-a2baa500d01d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:57.857488 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-cce74a1c-21b4-4be9-b6cb-a2baa500d01d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:57.865954 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-cce74a1c-21b4-4be9-b6cb-a2baa500d01d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1731 microversion: 2.1 time: 0.226924 Jul 20 15:35:57.866577 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 233/465] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:57 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1731 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:58.883113 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-0a0f9a47-a488-4fc7-bc55-032b0856493d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:58.883880 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-0a0f9a47-a488-4fc7-bc55-032b0856493d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:58.890710 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0a0f9a47-a488-4fc7-bc55-032b0856493d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:58.891153 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0a0f9a47-a488-4fc7-bc55-032b0856493d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:58.891905 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0a0f9a47-a488-4fc7-bc55-032b0856493d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:58.892335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0a0f9a47-a488-4fc7-bc55-032b0856493d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:59.065477 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-0a0f9a47-a488-4fc7-bc55-032b0856493d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:35:59.074174 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-0a0f9a47-a488-4fc7-bc55-032b0856493d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1731 microversion: 2.1 time: 0.195103 Jul 20 15:35:59.074777 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 233/466] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:58 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:35:59.341003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-3f74ebfb-4567-4790-9d7b-5009208038c5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-883221412"}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:35:59.341593 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-3f74ebfb-4567-4790-9d7b-5009208038c5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:59.349257 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3f74ebfb-4567-4790-9d7b-5009208038c5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:59.349872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3f74ebfb-4567-4790-9d7b-5009208038c5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:59.350700 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3f74ebfb-4567-4790-9d7b-5009208038c5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:59.351134 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3f74ebfb-4567-4790-9d7b-5009208038c5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:59.353972 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:35:59.486934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.network.security_group_api [None req-3f74ebfb-4567-4790-9d7b-5009208038c5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Adding security group e2873b3f-98e3-41cd-af50-5b59a2a2aa96 to port 3f4230e5-b6b6-43aa-985b-67a345eed1aa Jul 20 15:35:59.945080 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-3f74ebfb-4567-4790-9d7b-5009208038c5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "POST /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257/action" status: 202 len: 0 microversion: 2.1 time: 0.609885 Jul 20 15:35:59.949769 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 234/467] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Jul 20 15:35:59 2022] POST /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:35:59.955328 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-32a65dcb-7c77-430b-b6f2-4d249e2c0ded tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:35:59.956070 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-32a65dcb-7c77-430b-b6f2-4d249e2c0ded tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:35:59.962906 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-a20efc2a-8e52-4d73-a6e5-d3c35662b297 req-e84ddd7f-dc83-40a8-9275-65515603352f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "170181c4-a3e8-494d-bef6-2048dd9b0257", "tag": "3f4230e5-b6b6-43aa-985b-67a345eed1aa"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:35:59.964835 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-32a65dcb-7c77-430b-b6f2-4d249e2c0ded tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:59.965395 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-32a65dcb-7c77-430b-b6f2-4d249e2c0ded tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:59.966452 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-32a65dcb-7c77-430b-b6f2-4d249e2c0ded tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:59.977520 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-32a65dcb-7c77-430b-b6f2-4d249e2c0ded tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:59.977933 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-a20efc2a-8e52-4d73-a6e5-d3c35662b297 req-e84ddd7f-dc83-40a8-9275-65515603352f service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:35:59.977933 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-a20efc2a-8e52-4d73-a6e5-d3c35662b297 req-e84ddd7f-dc83-40a8-9275-65515603352f service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:35:59.989314 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-a20efc2a-8e52-4d73-a6e5-d3c35662b297 req-e84ddd7f-dc83-40a8-9275-65515603352f service nova] Creating event network-changed:3f4230e5-b6b6-43aa-985b-67a345eed1aa for instance 170181c4-a3e8-494d-bef6-2048dd9b0257 on hv-cinder-81914 Jul 20 15:35:59.995669 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-a20efc2a-8e52-4d73-a6e5-d3c35662b297 req-e84ddd7f-dc83-40a8-9275-65515603352f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040998 Jul 20 15:35:59.997117 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 235/468] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:36:00.098296 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-bde8d913-f7f5-44e6-aee4-2d0943bd84f2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:00.101578 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-bde8d913-f7f5-44e6-aee4-2d0943bd84f2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:00.120946 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bde8d913-f7f5-44e6-aee4-2d0943bd84f2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:00.121402 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bde8d913-f7f5-44e6-aee4-2d0943bd84f2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:00.127898 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bde8d913-f7f5-44e6-aee4-2d0943bd84f2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:00.128475 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bde8d913-f7f5-44e6-aee4-2d0943bd84f2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:00.259543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-32a65dcb-7c77-430b-b6f2-4d249e2c0ded tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:00.276861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-32a65dcb-7c77-430b-b6f2-4d249e2c0ded tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1759 microversion: 2.1 time: 0.324912 Jul 20 15:36:00.278145 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 234/469] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:35:59 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1759 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:00.337657 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-bde8d913-f7f5-44e6-aee4-2d0943bd84f2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:00.356310 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-bde8d913-f7f5-44e6-aee4-2d0943bd84f2 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1731 microversion: 2.1 time: 0.267561 Jul 20 15:36:00.359949 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 236/470] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:00 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1731 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:01.373626 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-64385329-8a27-44cb-8dd4-3774ff9ba79a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:01.374346 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-64385329-8a27-44cb-8dd4-3774ff9ba79a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:01.381141 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-64385329-8a27-44cb-8dd4-3774ff9ba79a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:01.381588 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-64385329-8a27-44cb-8dd4-3774ff9ba79a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:01.382381 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-64385329-8a27-44cb-8dd4-3774ff9ba79a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:01.382826 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-64385329-8a27-44cb-8dd4-3774ff9ba79a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:01.516700 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-64385329-8a27-44cb-8dd4-3774ff9ba79a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:01.524757 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-64385329-8a27-44cb-8dd4-3774ff9ba79a tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1731 microversion: 2.1 time: 0.155481 Jul 20 15:36:01.525333 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 235/471] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:01 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:02.543362 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e821e3bd-6aa3-4482-a4f3-18df41e3bd07 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:02.543966 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e821e3bd-6aa3-4482-a4f3-18df41e3bd07 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:02.550866 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e821e3bd-6aa3-4482-a4f3-18df41e3bd07 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:02.551366 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e821e3bd-6aa3-4482-a4f3-18df41e3bd07 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:02.552060 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e821e3bd-6aa3-4482-a4f3-18df41e3bd07 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:02.552492 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e821e3bd-6aa3-4482-a4f3-18df41e3bd07 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:02.699037 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e821e3bd-6aa3-4482-a4f3-18df41e3bd07 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:02.707079 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e821e3bd-6aa3-4482-a4f3-18df41e3bd07 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1731 microversion: 2.1 time: 0.168168 Jul 20 15:36:02.707864 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 237/472] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:02 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:36:03.725026 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-bf10976c-3df8-484f-b9cd-883d67bfd386 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:03.725625 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-bf10976c-3df8-484f-b9cd-883d67bfd386 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:03.727954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=78 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:03.732687 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bf10976c-3df8-484f-b9cd-883d67bfd386 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:03.733124 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bf10976c-3df8-484f-b9cd-883d67bfd386 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:03.733875 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bf10976c-3df8-484f-b9cd-883d67bfd386 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:03.734327 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bf10976c-3df8-484f-b9cd-883d67bfd386 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:03.879516 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-bf10976c-3df8-484f-b9cd-883d67bfd386 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:03.887992 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-bf10976c-3df8-484f-b9cd-883d67bfd386 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1731 microversion: 2.1 time: 0.167014 Jul 20 15:36:03.888559 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 236/473] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:03 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:04.905643 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ec1cbf81-3a5f-4369-b11a-44544e9313a7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:04.906163 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ec1cbf81-3a5f-4369-b11a-44544e9313a7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:04.912571 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ec1cbf81-3a5f-4369-b11a-44544e9313a7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:04.913013 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ec1cbf81-3a5f-4369-b11a-44544e9313a7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:04.913759 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ec1cbf81-3a5f-4369-b11a-44544e9313a7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:04.914181 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ec1cbf81-3a5f-4369-b11a-44544e9313a7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:05.061346 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-ec1cbf81-3a5f-4369-b11a-44544e9313a7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:05.071100 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-ec1cbf81-3a5f-4369-b11a-44544e9313a7 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1731 microversion: 2.1 time: 0.169892 Jul 20 15:36:05.071692 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 238/474] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:04 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:06.092118 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b7602ae8-4149-4edc-8d54-2a043a1bb2ef tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:06.092959 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b7602ae8-4149-4edc-8d54-2a043a1bb2ef tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:06.099571 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b7602ae8-4149-4edc-8d54-2a043a1bb2ef tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:06.100103 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b7602ae8-4149-4edc-8d54-2a043a1bb2ef tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:06.101066 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b7602ae8-4149-4edc-8d54-2a043a1bb2ef tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:06.101500 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b7602ae8-4149-4edc-8d54-2a043a1bb2ef tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:06.251139 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b7602ae8-4149-4edc-8d54-2a043a1bb2ef tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:06.259528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b7602ae8-4149-4edc-8d54-2a043a1bb2ef tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1731 microversion: 2.1 time: 0.172324 Jul 20 15:36:06.260104 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 237/475] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:06 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:07.277955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-0e159c12-79c5-437b-a95a-650711863277 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:07.278646 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-0e159c12-79c5-437b-a95a-650711863277 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:07.285229 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0e159c12-79c5-437b-a95a-650711863277 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:07.285691 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0e159c12-79c5-437b-a95a-650711863277 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:07.286453 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0e159c12-79c5-437b-a95a-650711863277 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:07.286885 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0e159c12-79c5-437b-a95a-650711863277 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:07.421144 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-0e159c12-79c5-437b-a95a-650711863277 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:07.439808 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-0e159c12-79c5-437b-a95a-650711863277 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1731 microversion: 2.1 time: 0.165385 Jul 20 15:36:07.441511 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 239/476] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:07 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:08.458862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-3892f9ff-d855-4be1-95d7-1668690b50ad tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:08.459471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-3892f9ff-d855-4be1-95d7-1668690b50ad tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:08.467133 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3892f9ff-d855-4be1-95d7-1668690b50ad tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:08.467698 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3892f9ff-d855-4be1-95d7-1668690b50ad tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:08.468459 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3892f9ff-d855-4be1-95d7-1668690b50ad tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:08.468890 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3892f9ff-d855-4be1-95d7-1668690b50ad tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:08.607865 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-3892f9ff-d855-4be1-95d7-1668690b50ad tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:08.616227 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-3892f9ff-d855-4be1-95d7-1668690b50ad tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1731 microversion: 2.1 time: 0.161210 Jul 20 15:36:08.616798 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 238/477] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:08 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:09.633246 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-1e6210fd-7074-4f4c-b5f4-bc8e576e9560 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:09.633866 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-1e6210fd-7074-4f4c-b5f4-bc8e576e9560 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:09.640452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1e6210fd-7074-4f4c-b5f4-bc8e576e9560 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:09.640890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1e6210fd-7074-4f4c-b5f4-bc8e576e9560 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:09.641638 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1e6210fd-7074-4f4c-b5f4-bc8e576e9560 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:09.642063 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1e6210fd-7074-4f4c-b5f4-bc8e576e9560 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:09.774837 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-1e6210fd-7074-4f4c-b5f4-bc8e576e9560 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:09.783701 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-1e6210fd-7074-4f4c-b5f4-bc8e576e9560 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1711 microversion: 2.1 time: 0.154402 Jul 20 15:36:09.784290 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 240/478] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:09 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1711 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:09.897012 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-44062e02-772a-49ec-b73e-f5b32ebfd784 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:09.897633 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-44062e02-772a-49ec-b73e-f5b32ebfd784 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:09.904600 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-44062e02-772a-49ec-b73e-f5b32ebfd784 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:09.905059 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-44062e02-772a-49ec-b73e-f5b32ebfd784 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:09.905842 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-44062e02-772a-49ec-b73e-f5b32ebfd784 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:09.906301 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-44062e02-772a-49ec-b73e-f5b32ebfd784 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:10.067064 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-a8dc8697-83a3-404f-b059-0cde6be17e0a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-510789661", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-419272811", "security_groups": [{"name": "tempest-secgroup-smoke-1190445814"}], "networks": [{"uuid": "83eae464-5738-40f7-a1db-5e4b986b02e4"}], "block_device_mapping_v2": [{"uuid": "154e8cfb-3f96-47de-ae54-bd8030403ca9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:36:10.070129 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-44062e02-772a-49ec-b73e-f5b32ebfd784 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] HTTP exception thrown: Cannot 'detach_volume' instance 91beb453-6320-472a-951c-3fda16747994 while it is in vm_state rescued Jul 20 15:36:10.073305 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-44062e02-772a-49ec-b73e-f5b32ebfd784 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Request method failure captured: Jul 20 15:36:10.073305 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: DELETE /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994/os-volume_attachments/90feec83-6635-4a4c-bcc6-8c3bc1edae76 HTTP/1.1 Jul 20 15:36:10.073305 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:36:10.073305 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:36:10.073305 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:36:10.073305 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:36:10.073305 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:36:10.073305 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:36:10.073305 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:36:10.073305 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:36:10.073305 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2B_nGe2iOCK4tpUXv7QabEEnZaZW6RYPqleka0psoTfCGUPxAgJvaFOHiUD5txfR4A4Hv1RzSFAd2v9PbHR17R2ddNfAKs2jQu_tXTgNRWpbrjgsTUb2vYhREm-bYeMJTibFF78_Vxw9bGxCNNDb--ZMo_XhlRZwYM49r3qyh0pb7pM Jul 20 15:36:10.073305 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:36:10.073305 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:36:10.073305 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:36:10.073305 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:36:10.073305 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:36:10.073305 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:36:10.073305 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 61872ef687074f5791a2cc46732bebdf Jul 20 15:36:10.073305 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1769185307 Jul 20 15:36:10.073305 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:36:10.073305 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:36:10.075902 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/61872ef687074f5791a2cc46732bebdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/61872ef687074f5791a2cc46732bebdf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_61872ef687074f5791a2cc46732bebdf", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/61872ef687074f5791a2cc46732bebdf"}]}] Jul 20 15:36:10.075902 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1769185307 Jul 20 15:36:10.075902 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 61872ef687074f5791a2cc46732bebdf Jul 20 15:36:10.075902 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1769185307 Jul 20 15:36:10.075902 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-ServerRescueNegativeTestJSON-1769185307-project Jul 20 15:36:10.075902 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:36:10.075902 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:36:10.075902 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: ebbcfe6341a3486d93e12c09f83954dc Jul 20 15:36:10.075902 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1769185307-project Jul 20 15:36:10.075902 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:36:10.075902 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Cannot 'detach_volume' instance 91beb453-6320-472a-951c-3fda16747994 while it is in vm_state rescued Jul 20 15:36:10.076670 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'server_id': '91beb453-6320-472a-951c-3fda16747994', 'id': '90feec83-6635-4a4c-bcc6-8c3bc1edae76'} Jul 20 15:36:10.076670 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:36:10.076670 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:36:10.076670 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 15:36:10.076670 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 15:36:10.076670 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 15:36:10.076670 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 15:36:10.076670 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 15:36:10.076670 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 15:36:10.076670 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 91beb453-6320-472a-951c-3fda16747994 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 20 15:36:10.076670 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:36:10.076670 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:36:10.076670 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:36:10.076670 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:36:10.076670 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:36:10.076670 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:36:10.076670 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:36:10.076670 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:36:10.076670 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:36:10.076670 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:36:10.078607 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 20 15:36:10.078607 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 15:36:10.078607 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 15:36:10.078607 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 15:36:10.078607 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 91beb453-6320-472a-951c-3fda16747994 while it is in vm_state rescued Jul 20 15:36:10.078607 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:36:10.078607 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:36:10.078607 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:36:10.078607 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:36:10.078607 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:36:10.078607 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:36:10.078607 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:36:10.078607 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:36:10.078607 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 91beb453-6320-472a-951c-3fda16747994 while it is in vm_state rescued Jul 20 15:36:10.078607 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:36:10.078607 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-44062e02-772a-49ec-b73e-f5b32ebfd784 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Returning 409 to user: Cannot 'detach_volume' instance 91beb453-6320-472a-951c-3fda16747994 while it is in vm_state rescued {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:36:10.081480 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-44062e02-772a-49ec-b73e-f5b32ebfd784 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "DELETE /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994/os-volume_attachments/90feec83-6635-4a4c-bcc6-8c3bc1edae76" status: 409 len: 152 microversion: 2.1 time: 0.183486 Jul 20 15:36:10.081480 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 239/479] 10.222.0.78 () {58 vars in 1415 bytes} [Wed Jul 20 15:36:09 2022] DELETE /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994/os-volume_attachments/90feec83-6635-4a4c-bcc6-8c3bc1edae76 => generated 152 bytes in 186 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 15:36:10.093890 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-46a928cd-2d59-4579-a7c3-0659ec328d97 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:36:10.093890 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-46a928cd-2d59-4579-a7c3-0659ec328d97 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:10.108411 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-46a928cd-2d59-4579-a7c3-0659ec328d97 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:10.109080 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-46a928cd-2d59-4579-a7c3-0659ec328d97 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:10.110330 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-46a928cd-2d59-4579-a7c3-0659ec328d97 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:10.111000 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-46a928cd-2d59-4579-a7c3-0659ec328d97 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:10.256753 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.network.neutron [None req-a8dc8697-83a3-404f-b059-0cde6be17e0a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] validate_networks() for [('83eae464-5738-40f7-a1db-5e4b986b02e4', None, None, None, None, None)] {{(pid=124711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 15:36:10.429339 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-46a928cd-2d59-4579-a7c3-0659ec328d97 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "POST /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994/action" status: 202 len: 0 microversion: 2.1 time: 0.343774 Jul 20 15:36:10.430132 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 240/480] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Jul 20 15:36:10 2022] POST /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 15:36:10.442014 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-7376cc6b-decc-4739-be45-7fc165c9c535 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:10.442824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-7376cc6b-decc-4739-be45-7fc165c9c535 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:10.451085 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7376cc6b-decc-4739-be45-7fc165c9c535 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:10.455292 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7376cc6b-decc-4739-be45-7fc165c9c535 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:10.455292 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7376cc6b-decc-4739-be45-7fc165c9c535 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:10.455292 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7376cc6b-decc-4739-be45-7fc165c9c535 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:10.724724 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-7376cc6b-decc-4739-be45-7fc165c9c535 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:10.735828 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-7376cc6b-decc-4739-be45-7fc165c9c535 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1719 microversion: 2.1 time: 0.299368 Jul 20 15:36:10.736428 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 241/481] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:10 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1719 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:36:10.851474 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-a8dc8697-83a3-404f-b059-0cde6be17e0a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Flavor limits 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 15:36:10.852033 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-a8dc8697-83a3-404f-b059-0cde6be17e0a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Image limits 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 15:36:10.852630 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-a8dc8697-83a3-404f-b059-0cde6be17e0a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Flavor pref 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 15:36:10.853145 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-a8dc8697-83a3-404f-b059-0cde6be17e0a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Image pref 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 15:36:10.853676 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-a8dc8697-83a3-404f-b059-0cde6be17e0a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 15:36:10.864615 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a8dc8697-83a3-404f-b059-0cde6be17e0a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:10.865069 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a8dc8697-83a3-404f-b059-0cde6be17e0a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:10.865935 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a8dc8697-83a3-404f-b059-0cde6be17e0a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:10.866445 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a8dc8697-83a3-404f-b059-0cde6be17e0a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:10.886488 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-a8dc8697-83a3-404f-b059-0cde6be17e0a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Getting quotas for project 09d92d320f8748c58aca3fd6a8776540. Resources: {'instances', 'ram', 'cores'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:36:10.891406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-a8dc8697-83a3-404f-b059-0cde6be17e0a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Getting quotas for user ec2e023235a343dd81754211ee102f3c and project 09d92d320f8748c58aca3fd6a8776540. Resources: {'instances', 'ram', 'cores'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:36:10.965398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-a8dc8697-83a3-404f-b059-0cde6be17e0a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Going to run 1 instances... {{(pid=124711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 15:36:10.968457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-a8dc8697-83a3-404f-b059-0cde6be17e0a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='154e8cfb-3f96-47de-ae54-bd8030403ca9',volume_size=None,volume_type=None)] {{(pid=124711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 15:36:11.677275 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-a8dc8697-83a3-404f-b059-0cde6be17e0a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.617170 Jul 20 15:36:11.677844 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 241/482] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Jul 20 15:36:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 15:36:11.688453 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-ac5784b8-47b4-4964-9a93-8a83bca663c0 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:11.689055 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-ac5784b8-47b4-4964-9a93-8a83bca663c0 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:11.745112 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-ac5784b8-47b4-4964-9a93-8a83bca663c0 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:11.753692 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-ac5784b8-47b4-4964-9a93-8a83bca663c0 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1087 microversion: 2.1 time: 0.069733 Jul 20 15:36:11.764233 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5638ef03-8d93-4d4d-a2db-9d6485f2e39b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:11.764669 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 242/483] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:11 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1087 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:11.764765 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5638ef03-8d93-4d4d-a2db-9d6485f2e39b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:11.764765 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5638ef03-8d93-4d4d-a2db-9d6485f2e39b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:11.764765 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5638ef03-8d93-4d4d-a2db-9d6485f2e39b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:11.764765 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5638ef03-8d93-4d4d-a2db-9d6485f2e39b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:11.765128 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5638ef03-8d93-4d4d-a2db-9d6485f2e39b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:11.914126 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5638ef03-8d93-4d4d-a2db-9d6485f2e39b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:11.923442 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5638ef03-8d93-4d4d-a2db-9d6485f2e39b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1719 microversion: 2.1 time: 0.173441 Jul 20 15:36:11.924041 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 242/484] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:11 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:12.779055 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-25827b2d-42f8-43f2-a59f-da2dfe2e7c11 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:12.779655 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-25827b2d-42f8-43f2-a59f-da2dfe2e7c11 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:12.837487 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-25827b2d-42f8-43f2-a59f-da2dfe2e7c11 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:12.844719 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-25827b2d-42f8-43f2-a59f-da2dfe2e7c11 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1087 microversion: 2.1 time: 0.069785 Jul 20 15:36:12.845285 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 243/485] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:12 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1087 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:12.941810 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ccb0270d-444b-4b77-9ccb-6da0734bdc4c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:12.942553 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ccb0270d-444b-4b77-9ccb-6da0734bdc4c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:12.949167 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ccb0270d-444b-4b77-9ccb-6da0734bdc4c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:12.949630 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ccb0270d-444b-4b77-9ccb-6da0734bdc4c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:12.952059 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ccb0270d-444b-4b77-9ccb-6da0734bdc4c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:12.952059 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ccb0270d-444b-4b77-9ccb-6da0734bdc4c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:13.086697 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-ccb0270d-444b-4b77-9ccb-6da0734bdc4c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:13.095992 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-ccb0270d-444b-4b77-9ccb-6da0734bdc4c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1719 microversion: 2.1 time: 0.158288 Jul 20 15:36:13.096783 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 243/486] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:12 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:13.861088 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b1e640c7-3c10-48ee-95f5-a70bef7ac28f tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:13.861650 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b1e640c7-3c10-48ee-95f5-a70bef7ac28f tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:13.868329 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b1e640c7-3c10-48ee-95f5-a70bef7ac28f tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:13.868801 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b1e640c7-3c10-48ee-95f5-a70bef7ac28f tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:13.869565 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b1e640c7-3c10-48ee-95f5-a70bef7ac28f tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:13.870002 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b1e640c7-3c10-48ee-95f5-a70bef7ac28f tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:13.937071 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b1e640c7-3c10-48ee-95f5-a70bef7ac28f tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:13.944830 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b1e640c7-3c10-48ee-95f5-a70bef7ac28f tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1129 microversion: 2.1 time: 0.087758 Jul 20 15:36:13.945396 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 244/487] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:13 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1129 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:14.113729 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-bc866fee-d2f4-4ab3-b123-d80efc1c09ed tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:14.114283 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-bc866fee-d2f4-4ab3-b123-d80efc1c09ed tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:14.120790 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bc866fee-d2f4-4ab3-b123-d80efc1c09ed tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:14.121243 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bc866fee-d2f4-4ab3-b123-d80efc1c09ed tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:14.122029 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bc866fee-d2f4-4ab3-b123-d80efc1c09ed tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:14.122492 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bc866fee-d2f4-4ab3-b123-d80efc1c09ed tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:14.267887 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-bc866fee-d2f4-4ab3-b123-d80efc1c09ed tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:14.277706 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-bc866fee-d2f4-4ab3-b123-d80efc1c09ed tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1719 microversion: 2.1 time: 0.167889 Jul 20 15:36:14.281646 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 244/488] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:14 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:14.962727 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-3e84ef64-6f0b-4c75-a708-4d5666788e3b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:14.963302 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-3e84ef64-6f0b-4c75-a708-4d5666788e3b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:14.971393 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3e84ef64-6f0b-4c75-a708-4d5666788e3b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:14.971847 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3e84ef64-6f0b-4c75-a708-4d5666788e3b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:14.972623 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3e84ef64-6f0b-4c75-a708-4d5666788e3b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:14.973056 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3e84ef64-6f0b-4c75-a708-4d5666788e3b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:15.037565 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-3e84ef64-6f0b-4c75-a708-4d5666788e3b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:15.046533 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-3e84ef64-6f0b-4c75-a708-4d5666788e3b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1185 microversion: 2.1 time: 0.087954 Jul 20 15:36:15.047121 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 245/489] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:14 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:36:15.297383 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-50cefe76-dffc-4079-8c72-c7a6bd1a1f8c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:15.297990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-50cefe76-dffc-4079-8c72-c7a6bd1a1f8c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:15.309762 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-50cefe76-dffc-4079-8c72-c7a6bd1a1f8c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:15.310540 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-50cefe76-dffc-4079-8c72-c7a6bd1a1f8c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:15.311331 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-50cefe76-dffc-4079-8c72-c7a6bd1a1f8c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:15.311764 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-50cefe76-dffc-4079-8c72-c7a6bd1a1f8c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:15.455515 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-50cefe76-dffc-4079-8c72-c7a6bd1a1f8c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:15.464075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-50cefe76-dffc-4079-8c72-c7a6bd1a1f8c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1725 microversion: 2.1 time: 0.170777 Jul 20 15:36:15.464657 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 245/490] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:15 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:15.483841 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-aaaf7ccb-4b23-4359-8c91-7555341c2692 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:15.484358 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-aaaf7ccb-4b23-4359-8c91-7555341c2692 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:15.490486 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-aaaf7ccb-4b23-4359-8c91-7555341c2692 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:15.490935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-aaaf7ccb-4b23-4359-8c91-7555341c2692 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:15.491707 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-aaaf7ccb-4b23-4359-8c91-7555341c2692 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:15.492147 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-aaaf7ccb-4b23-4359-8c91-7555341c2692 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:15.583875 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-aaaf7ccb-4b23-4359-8c91-7555341c2692 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103914 Jul 20 15:36:15.584473 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 246/491] 10.222.0.78 () {58 vars in 1274 bytes} [Wed Jul 20 15:36:15 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:36:16.064119 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-efa0786d-e273-4d29-8035-5f2ef14e4c02 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:16.065218 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-efa0786d-e273-4d29-8035-5f2ef14e4c02 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:16.072094 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-efa0786d-e273-4d29-8035-5f2ef14e4c02 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:16.072634 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-efa0786d-e273-4d29-8035-5f2ef14e4c02 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:16.073642 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-efa0786d-e273-4d29-8035-5f2ef14e4c02 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:16.074157 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-efa0786d-e273-4d29-8035-5f2ef14e4c02 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:16.365297 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-efa0786d-e273-4d29-8035-5f2ef14e4c02 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:16.373496 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-efa0786d-e273-4d29-8035-5f2ef14e4c02 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1271 microversion: 2.1 time: 0.314415 Jul 20 15:36:16.374247 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 246/492] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:16 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1271 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:16.970253 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-4aa0f9c6-b9a6-4f5c-9aea-e3323dc32c92 req-44d85427-6894-4e7d-8fe1-34bcab539477 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91beb453-6320-472a-951c-3fda16747994", "tag": "e2135397-d828-46e2-a219-f788f406eb08"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:36:16.981739 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-4aa0f9c6-b9a6-4f5c-9aea-e3323dc32c92 req-44d85427-6894-4e7d-8fe1-34bcab539477 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:16.982422 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-4aa0f9c6-b9a6-4f5c-9aea-e3323dc32c92 req-44d85427-6894-4e7d-8fe1-34bcab539477 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:16.995611 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-4aa0f9c6-b9a6-4f5c-9aea-e3323dc32c92 req-44d85427-6894-4e7d-8fe1-34bcab539477 service nova] Creating event network-changed:e2135397-d828-46e2-a219-f788f406eb08 for instance 91beb453-6320-472a-951c-3fda16747994 on hv-cinder-81914 Jul 20 15:36:17.001561 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-4aa0f9c6-b9a6-4f5c-9aea-e3323dc32c92 req-44d85427-6894-4e7d-8fe1-34bcab539477 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036360 Jul 20 15:36:17.002165 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 247/493] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:36:17.112386 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-0d18a68a-6501-4ca2-bcad-303a8d8cccdb req-ba84cf64-c892-41c9-af04-b4e56c30f8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "562e58cb-a1c0-4582-b4aa-46abf6053c11", "tag": "5dcfcdca-0e07-4def-8734-604f0229a302"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:36:17.124778 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-0d18a68a-6501-4ca2-bcad-303a8d8cccdb req-ba84cf64-c892-41c9-af04-b4e56c30f8f6 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:17.125535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-0d18a68a-6501-4ca2-bcad-303a8d8cccdb req-ba84cf64-c892-41c9-af04-b4e56c30f8f6 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:17.140601 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-0d18a68a-6501-4ca2-bcad-303a8d8cccdb req-ba84cf64-c892-41c9-af04-b4e56c30f8f6 service nova] Creating event network-changed:5dcfcdca-0e07-4def-8734-604f0229a302 for instance 562e58cb-a1c0-4582-b4aa-46abf6053c11 on hv-cinder-81914 Jul 20 15:36:17.151819 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-0d18a68a-6501-4ca2-bcad-303a8d8cccdb req-ba84cf64-c892-41c9-af04-b4e56c30f8f6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043153 Jul 20 15:36:17.153300 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 247/494] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:36:17.391880 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-06eceebd-2740-4ca8-a77b-e27fb25ed230 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:17.392895 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-06eceebd-2740-4ca8-a77b-e27fb25ed230 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:17.399635 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-06eceebd-2740-4ca8-a77b-e27fb25ed230 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:17.400393 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-06eceebd-2740-4ca8-a77b-e27fb25ed230 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:17.401243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-06eceebd-2740-4ca8-a77b-e27fb25ed230 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:17.401931 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-06eceebd-2740-4ca8-a77b-e27fb25ed230 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:17.551433 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-06eceebd-2740-4ca8-a77b-e27fb25ed230 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:17.560083 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-06eceebd-2740-4ca8-a77b-e27fb25ed230 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1259 microversion: 2.1 time: 0.172673 Jul 20 15:36:17.560668 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 248/495] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:17 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:17.843802 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-2bd6167a-2894-4c30-996e-b82b18497b05 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "543b082b-2efc-43dd-98a5-52a5aaa169c3", "device": "/dev/sdb"}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:36:17.846921 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-2bd6167a-2894-4c30-996e-b82b18497b05 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:17.855986 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2bd6167a-2894-4c30-996e-b82b18497b05 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:17.857212 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2bd6167a-2894-4c30-996e-b82b18497b05 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:17.857978 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2bd6167a-2894-4c30-996e-b82b18497b05 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:17.858432 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2bd6167a-2894-4c30-996e-b82b18497b05 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:18.577868 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-da0938ce-56d4-4c8a-bdfd-a250bec55671 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:18.578457 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-da0938ce-56d4-4c8a-bdfd-a250bec55671 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:18.585314 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-da0938ce-56d4-4c8a-bdfd-a250bec55671 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:18.585762 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-da0938ce-56d4-4c8a-bdfd-a250bec55671 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:18.586549 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-da0938ce-56d4-4c8a-bdfd-a250bec55671 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:18.586977 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-da0938ce-56d4-4c8a-bdfd-a250bec55671 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:18.656883 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-2bd6167a-2894-4c30-996e-b82b18497b05 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "POST /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.819511 Jul 20 15:36:18.657509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 248/496] 10.222.0.78 () {60 vars in 1322 bytes} [Wed Jul 20 15:36:17 2022] POST /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc/os-volume_attachments => generated 194 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:36:18.727903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-da0938ce-56d4-4c8a-bdfd-a250bec55671 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:18.735762 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-da0938ce-56d4-4c8a-bdfd-a250bec55671 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1259 microversion: 2.1 time: 0.162470 Jul 20 15:36:18.736341 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 249/497] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:18 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:36:19.016409 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-a2327607-4d96-4ac4-accf-8a857e538717 req-0ef23901-433f-4ab4-ac0a-4a362061f56b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91beb453-6320-472a-951c-3fda16747994", "tag": "e2135397-d828-46e2-a219-f788f406eb08"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:36:19.025692 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-a2327607-4d96-4ac4-accf-8a857e538717 req-0ef23901-433f-4ab4-ac0a-4a362061f56b service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:19.026128 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-a2327607-4d96-4ac4-accf-8a857e538717 req-0ef23901-433f-4ab4-ac0a-4a362061f56b service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:19.037942 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-a2327607-4d96-4ac4-accf-8a857e538717 req-0ef23901-433f-4ab4-ac0a-4a362061f56b service nova] Creating event network-changed:e2135397-d828-46e2-a219-f788f406eb08 for instance 91beb453-6320-472a-951c-3fda16747994 on hv-cinder-81914 Jul 20 15:36:19.042990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-a2327607-4d96-4ac4-accf-8a857e538717 req-0ef23901-433f-4ab4-ac0a-4a362061f56b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030699 Jul 20 15:36:19.046026 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 249/498] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:36:19.752820 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-50d95dcf-2232-464a-b1e0-4af3ff3db5bc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:19.753593 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-50d95dcf-2232-464a-b1e0-4af3ff3db5bc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:19.760404 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-50d95dcf-2232-464a-b1e0-4af3ff3db5bc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:19.760860 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-50d95dcf-2232-464a-b1e0-4af3ff3db5bc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:19.761646 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-50d95dcf-2232-464a-b1e0-4af3ff3db5bc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:19.762081 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-50d95dcf-2232-464a-b1e0-4af3ff3db5bc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:19.767151 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:19.905430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-50d95dcf-2232-464a-b1e0-4af3ff3db5bc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:19.911997 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-50d95dcf-2232-464a-b1e0-4af3ff3db5bc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1259 microversion: 2.1 time: 0.162995 Jul 20 15:36:19.912721 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 250/499] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:19 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:36:20.926871 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=2 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:20.927556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=6 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:20.931771 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-b4070e3a-321f-4944-87d0-ed0e00073998 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:20.932533 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-b4070e3a-321f-4944-87d0-ed0e00073998 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:20.941053 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b4070e3a-321f-4944-87d0-ed0e00073998 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:20.944599 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b4070e3a-321f-4944-87d0-ed0e00073998 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:20.944599 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b4070e3a-321f-4944-87d0-ed0e00073998 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:20.944599 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b4070e3a-321f-4944-87d0-ed0e00073998 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:21.088131 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-b4070e3a-321f-4944-87d0-ed0e00073998 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:21.096536 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-b4070e3a-321f-4944-87d0-ed0e00073998 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1259 microversion: 2.1 time: 0.171095 Jul 20 15:36:21.097458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 250/500] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:20 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:22.113109 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-185379d5-5eea-4625-92cc-a05abb487c4b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:22.113740 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-185379d5-5eea-4625-92cc-a05abb487c4b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:22.120924 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-185379d5-5eea-4625-92cc-a05abb487c4b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:22.121367 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-185379d5-5eea-4625-92cc-a05abb487c4b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:22.122111 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-185379d5-5eea-4625-92cc-a05abb487c4b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:22.122607 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-185379d5-5eea-4625-92cc-a05abb487c4b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:22.258679 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-185379d5-5eea-4625-92cc-a05abb487c4b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:22.266954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-185379d5-5eea-4625-92cc-a05abb487c4b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1259 microversion: 2.1 time: 0.157662 Jul 20 15:36:22.270221 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 251/501] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:22 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:23.283581 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d6c4bce5-d7f3-4ffa-b0cd-f8d854d45dc6 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:23.295926 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-d6c4bce5-d7f3-4ffa-b0cd-f8d854d45dc6 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:23.295926 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:23.295926 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d6c4bce5-d7f3-4ffa-b0cd-f8d854d45dc6 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:23.295926 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d6c4bce5-d7f3-4ffa-b0cd-f8d854d45dc6 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:23.295926 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d6c4bce5-d7f3-4ffa-b0cd-f8d854d45dc6 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:23.296385 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d6c4bce5-d7f3-4ffa-b0cd-f8d854d45dc6 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:23.430942 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d6c4bce5-d7f3-4ffa-b0cd-f8d854d45dc6 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:23.439494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d6c4bce5-d7f3-4ffa-b0cd-f8d854d45dc6 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1259 microversion: 2.1 time: 0.160361 Jul 20 15:36:23.440070 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 251/502] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:23 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:24.456188 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-2439e4ea-b876-40e3-9991-b40f0e36fc4d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:24.456787 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-2439e4ea-b876-40e3-9991-b40f0e36fc4d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:24.458625 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=4 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:24.464112 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2439e4ea-b876-40e3-9991-b40f0e36fc4d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:24.464574 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2439e4ea-b876-40e3-9991-b40f0e36fc4d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:24.465381 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2439e4ea-b876-40e3-9991-b40f0e36fc4d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:24.465863 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2439e4ea-b876-40e3-9991-b40f0e36fc4d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:24.604533 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-2439e4ea-b876-40e3-9991-b40f0e36fc4d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:24.612558 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-2439e4ea-b876-40e3-9991-b40f0e36fc4d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1259 microversion: 2.1 time: 0.160232 Jul 20 15:36:24.613133 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 252/503] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:24 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:25.628938 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c0204949-8380-487d-badb-bd00b7343d91 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:25.629549 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c0204949-8380-487d-badb-bd00b7343d91 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:25.636371 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c0204949-8380-487d-badb-bd00b7343d91 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:25.636817 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c0204949-8380-487d-badb-bd00b7343d91 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:25.637571 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c0204949-8380-487d-badb-bd00b7343d91 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:25.638009 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c0204949-8380-487d-badb-bd00b7343d91 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:25.653539 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:25.777607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c0204949-8380-487d-badb-bd00b7343d91 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:25.785641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c0204949-8380-487d-badb-bd00b7343d91 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1259 microversion: 2.1 time: 0.160564 Jul 20 15:36:25.786196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 252/504] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:25 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:26.803268 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-ad9976b3-ff04-473b-88e0-5295fac417e8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:26.803992 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-ad9976b3-ff04-473b-88e0-5295fac417e8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:26.810618 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ad9976b3-ff04-473b-88e0-5295fac417e8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:26.811547 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ad9976b3-ff04-473b-88e0-5295fac417e8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:26.812310 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ad9976b3-ff04-473b-88e0-5295fac417e8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:26.812737 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ad9976b3-ff04-473b-88e0-5295fac417e8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:26.946203 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-ad9976b3-ff04-473b-88e0-5295fac417e8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:26.954632 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-ad9976b3-ff04-473b-88e0-5295fac417e8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1259 microversion: 2.1 time: 0.156167 Jul 20 15:36:26.955264 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 253/505] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:26 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:27.978924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5bd498e0-4663-407d-9842-9f28b1ab7a02 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:27.979616 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5bd498e0-4663-407d-9842-9f28b1ab7a02 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:27.987526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5bd498e0-4663-407d-9842-9f28b1ab7a02 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:27.988007 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5bd498e0-4663-407d-9842-9f28b1ab7a02 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:27.988779 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5bd498e0-4663-407d-9842-9f28b1ab7a02 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:27.989202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5bd498e0-4663-407d-9842-9f28b1ab7a02 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:28.135394 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5bd498e0-4663-407d-9842-9f28b1ab7a02 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:28.142937 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5bd498e0-4663-407d-9842-9f28b1ab7a02 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1259 microversion: 2.1 time: 0.168356 Jul 20 15:36:28.146922 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 253/506] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:27 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:36:29.160382 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-239636e4-deae-46fc-ae4f-2b78bb0c13d2 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:29.161022 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-239636e4-deae-46fc-ae4f-2b78bb0c13d2 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:29.167199 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-239636e4-deae-46fc-ae4f-2b78bb0c13d2 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:29.167649 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-239636e4-deae-46fc-ae4f-2b78bb0c13d2 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:29.168407 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-239636e4-deae-46fc-ae4f-2b78bb0c13d2 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:29.168839 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-239636e4-deae-46fc-ae4f-2b78bb0c13d2 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:29.305435 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-239636e4-deae-46fc-ae4f-2b78bb0c13d2 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:29.313236 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-239636e4-deae-46fc-ae4f-2b78bb0c13d2 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1259 microversion: 2.1 time: 0.156794 Jul 20 15:36:29.313803 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 254/507] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:29 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:30.330205 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-857357fe-9c8a-42d1-9a9b-d52c88a45a30 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:30.330894 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-857357fe-9c8a-42d1-9a9b-d52c88a45a30 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:30.337918 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-857357fe-9c8a-42d1-9a9b-d52c88a45a30 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:30.338402 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-857357fe-9c8a-42d1-9a9b-d52c88a45a30 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:30.339173 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-857357fe-9c8a-42d1-9a9b-d52c88a45a30 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:30.339605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-857357fe-9c8a-42d1-9a9b-d52c88a45a30 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:30.486202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-857357fe-9c8a-42d1-9a9b-d52c88a45a30 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:30.494776 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-857357fe-9c8a-42d1-9a9b-d52c88a45a30 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1259 microversion: 2.1 time: 0.168369 Jul 20 15:36:30.495361 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 254/508] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:30 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:31.512537 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-6fdd6087-64ea-4dbb-a842-e328101b2f5b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:31.513297 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-6fdd6087-64ea-4dbb-a842-e328101b2f5b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:31.520841 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6fdd6087-64ea-4dbb-a842-e328101b2f5b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:31.521293 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6fdd6087-64ea-4dbb-a842-e328101b2f5b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:31.522057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6fdd6087-64ea-4dbb-a842-e328101b2f5b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:31.522525 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6fdd6087-64ea-4dbb-a842-e328101b2f5b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:31.668416 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-6fdd6087-64ea-4dbb-a842-e328101b2f5b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:31.679874 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-6fdd6087-64ea-4dbb-a842-e328101b2f5b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1259 microversion: 2.1 time: 0.170978 Jul 20 15:36:31.680568 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 255/509] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:31 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:31.772705 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-226ce2be-5ff4-438f-83ba-830a1cca54b0 req-70cf5c35-8e71-45cf-883b-3b4cd0932607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562e58cb-a1c0-4582-b4aa-46abf6053c11", "name": "network-vif-plugged", "status": "completed", "tag": "5dcfcdca-0e07-4def-8734-604f0229a302"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:36:31.778790 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-226ce2be-5ff4-438f-83ba-830a1cca54b0 req-70cf5c35-8e71-45cf-883b-3b4cd0932607 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:31.779229 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-226ce2be-5ff4-438f-83ba-830a1cca54b0 req-70cf5c35-8e71-45cf-883b-3b4cd0932607 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:31.791483 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-226ce2be-5ff4-438f-83ba-830a1cca54b0 req-70cf5c35-8e71-45cf-883b-3b4cd0932607 service nova] Creating event network-vif-plugged:5dcfcdca-0e07-4def-8734-604f0229a302 for instance 562e58cb-a1c0-4582-b4aa-46abf6053c11 on hv-cinder-81914 Jul 20 15:36:31.796969 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-226ce2be-5ff4-438f-83ba-830a1cca54b0 req-70cf5c35-8e71-45cf-883b-3b4cd0932607 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030927 Jul 20 15:36:31.797606 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 255/510] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:36:32.699992 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-52631d20-122a-4737-a044-ba7227c70b79 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:32.700873 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-52631d20-122a-4737-a044-ba7227c70b79 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:32.708428 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-52631d20-122a-4737-a044-ba7227c70b79 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:32.708899 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-52631d20-122a-4737-a044-ba7227c70b79 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:32.709904 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-52631d20-122a-4737-a044-ba7227c70b79 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:32.710377 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-52631d20-122a-4737-a044-ba7227c70b79 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:32.849149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-52631d20-122a-4737-a044-ba7227c70b79 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:32.850736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ab46e281-0b45-4e1e-a1c2-2abdb1fdfc96 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:36:32.851770 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ab46e281-0b45-4e1e-a1c2-2abdb1fdfc96 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:32.858432 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-52631d20-122a-4737-a044-ba7227c70b79 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1259 microversion: 2.1 time: 0.163929 Jul 20 15:36:32.858756 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ab46e281-0b45-4e1e-a1c2-2abdb1fdfc96 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:32.859012 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 256/511] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:32 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:32.859202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ab46e281-0b45-4e1e-a1c2-2abdb1fdfc96 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:32.860032 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ab46e281-0b45-4e1e-a1c2-2abdb1fdfc96 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:32.860755 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ab46e281-0b45-4e1e-a1c2-2abdb1fdfc96 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:33.153530 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-ab46e281-0b45-4e1e-a1c2-2abdb1fdfc96 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "POST /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257/action" status: 202 len: 0 microversion: 2.1 time: 0.307072 Jul 20 15:36:33.154164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 256/512] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Jul 20 15:36:32 2022] POST /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 15:36:33.164454 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-38eea40d-3e19-4735-b848-4afbdf402dd5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:33.170958 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-38eea40d-3e19-4735-b848-4afbdf402dd5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:33.172263 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-38eea40d-3e19-4735-b848-4afbdf402dd5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:33.172791 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-38eea40d-3e19-4735-b848-4afbdf402dd5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:33.173668 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-38eea40d-3e19-4735-b848-4afbdf402dd5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:33.174369 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-38eea40d-3e19-4735-b848-4afbdf402dd5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:33.330279 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-38eea40d-3e19-4735-b848-4afbdf402dd5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:33.338692 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-38eea40d-3e19-4735-b848-4afbdf402dd5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1751 microversion: 2.1 time: 0.180120 Jul 20 15:36:33.339256 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 257/513] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:33 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:33.876468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-36b7b6dd-3909-4498-8800-aa13960a801b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:33.877216 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-36b7b6dd-3909-4498-8800-aa13960a801b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:33.883829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-36b7b6dd-3909-4498-8800-aa13960a801b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:33.884272 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-36b7b6dd-3909-4498-8800-aa13960a801b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:33.885025 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-36b7b6dd-3909-4498-8800-aa13960a801b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:33.885518 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-36b7b6dd-3909-4498-8800-aa13960a801b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:34.021758 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-36b7b6dd-3909-4498-8800-aa13960a801b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:34.029215 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-36b7b6dd-3909-4498-8800-aa13960a801b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1259 microversion: 2.1 time: 0.157493 Jul 20 15:36:34.030328 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 257/514] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:33 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:34.356148 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b35b29be-0498-4e1b-b507-779839dc7466 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:34.356752 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b35b29be-0498-4e1b-b507-779839dc7466 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:34.359678 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=48 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:34.364408 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b35b29be-0498-4e1b-b507-779839dc7466 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:34.364872 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b35b29be-0498-4e1b-b507-779839dc7466 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:34.365886 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b35b29be-0498-4e1b-b507-779839dc7466 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:34.366055 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b35b29be-0498-4e1b-b507-779839dc7466 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:34.522225 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b35b29be-0498-4e1b-b507-779839dc7466 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:34.530718 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b35b29be-0498-4e1b-b507-779839dc7466 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1751 microversion: 2.1 time: 0.178352 Jul 20 15:36:34.531317 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 258/515] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:34 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:35.047159 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c1282ef9-5e84-40f8-8960-985a94821fa9 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:35.047763 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c1282ef9-5e84-40f8-8960-985a94821fa9 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:35.054471 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c1282ef9-5e84-40f8-8960-985a94821fa9 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:35.054944 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c1282ef9-5e84-40f8-8960-985a94821fa9 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:35.055699 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c1282ef9-5e84-40f8-8960-985a94821fa9 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:35.056196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c1282ef9-5e84-40f8-8960-985a94821fa9 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:35.190932 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c1282ef9-5e84-40f8-8960-985a94821fa9 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:35.199846 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c1282ef9-5e84-40f8-8960-985a94821fa9 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1259 microversion: 2.1 time: 0.157022 Jul 20 15:36:35.200420 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 258/516] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:35 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:36:35.549174 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-61a59c7d-62b7-4bbd-b998-0454d9e258e8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:35.549754 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-61a59c7d-62b7-4bbd-b998-0454d9e258e8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:35.560593 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-61a59c7d-62b7-4bbd-b998-0454d9e258e8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:35.561041 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-61a59c7d-62b7-4bbd-b998-0454d9e258e8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:35.561844 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-61a59c7d-62b7-4bbd-b998-0454d9e258e8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:35.562331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-61a59c7d-62b7-4bbd-b998-0454d9e258e8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:35.716345 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-61a59c7d-62b7-4bbd-b998-0454d9e258e8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:35.727012 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-61a59c7d-62b7-4bbd-b998-0454d9e258e8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1751 microversion: 2.1 time: 0.182383 Jul 20 15:36:35.727587 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 259/517] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:35 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:36.217848 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c9940204-bd73-48c6-82df-41bfd6fe9e80 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:36.218489 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c9940204-bd73-48c6-82df-41bfd6fe9e80 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:36.225644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c9940204-bd73-48c6-82df-41bfd6fe9e80 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:36.226087 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c9940204-bd73-48c6-82df-41bfd6fe9e80 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:36.226891 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c9940204-bd73-48c6-82df-41bfd6fe9e80 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:36.227353 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c9940204-bd73-48c6-82df-41bfd6fe9e80 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:36.390105 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c9940204-bd73-48c6-82df-41bfd6fe9e80 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:36.401606 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c9940204-bd73-48c6-82df-41bfd6fe9e80 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1259 microversion: 2.1 time: 0.187584 Jul 20 15:36:36.402352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 259/518] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:36 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1259 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:36.743805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-895d9515-3365-4a2f-98f6-f327f842e802 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:36.744462 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-895d9515-3365-4a2f-98f6-f327f842e802 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:36.751189 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-895d9515-3365-4a2f-98f6-f327f842e802 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:36.751636 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-895d9515-3365-4a2f-98f6-f327f842e802 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:36.752407 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-895d9515-3365-4a2f-98f6-f327f842e802 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:36.752923 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-895d9515-3365-4a2f-98f6-f327f842e802 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:36.929101 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-895d9515-3365-4a2f-98f6-f327f842e802 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:36.935599 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-895d9515-3365-4a2f-98f6-f327f842e802 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1751 microversion: 2.1 time: 0.195550 Jul 20 15:36:36.936180 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 260/519] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:36 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1751 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:37.419883 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e09eb146-fce8-4511-a871-7526352985cc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:37.420618 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e09eb146-fce8-4511-a871-7526352985cc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:37.428350 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e09eb146-fce8-4511-a871-7526352985cc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:37.428858 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e09eb146-fce8-4511-a871-7526352985cc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:37.429634 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e09eb146-fce8-4511-a871-7526352985cc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:37.430064 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e09eb146-fce8-4511-a871-7526352985cc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:37.583299 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e09eb146-fce8-4511-a871-7526352985cc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:37.592017 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e09eb146-fce8-4511-a871-7526352985cc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1443 microversion: 2.1 time: 0.177229 Jul 20 15:36:37.592599 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 260/520] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:37 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1443 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:37.608800 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-3270c8fa-51c6-4d8d-b300-653d29dfb439 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:37.609410 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-3270c8fa-51c6-4d8d-b300-653d29dfb439 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:37.615532 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3270c8fa-51c6-4d8d-b300-653d29dfb439 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:37.616031 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3270c8fa-51c6-4d8d-b300-653d29dfb439 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:37.616800 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3270c8fa-51c6-4d8d-b300-653d29dfb439 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:37.617232 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3270c8fa-51c6-4d8d-b300-653d29dfb439 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:37.770469 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-3270c8fa-51c6-4d8d-b300-653d29dfb439 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:37.775896 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-3270c8fa-51c6-4d8d-b300-653d29dfb439 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1443 microversion: 2.1 time: 0.170870 Jul 20 15:36:37.776583 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 261/521] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:37 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1443 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:36:37.956301 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ed66a23b-eb11-4505-99dd-8e0377ae7fd3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:37.962099 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ed66a23b-eb11-4505-99dd-8e0377ae7fd3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:37.964377 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ed66a23b-eb11-4505-99dd-8e0377ae7fd3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:37.964823 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ed66a23b-eb11-4505-99dd-8e0377ae7fd3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:37.965606 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ed66a23b-eb11-4505-99dd-8e0377ae7fd3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:37.966040 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ed66a23b-eb11-4505-99dd-8e0377ae7fd3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:38.223104 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-ed66a23b-eb11-4505-99dd-8e0377ae7fd3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:38.231861 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-ed66a23b-eb11-4505-99dd-8e0377ae7fd3 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1751 microversion: 2.1 time: 0.280039 Jul 20 15:36:38.232517 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 261/522] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:37 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1751 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:39.254694 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d5402541-4a05-4a6b-ba19-eef856e5d1e8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:39.255543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d5402541-4a05-4a6b-ba19-eef856e5d1e8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:39.263065 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d5402541-4a05-4a6b-ba19-eef856e5d1e8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:39.264193 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d5402541-4a05-4a6b-ba19-eef856e5d1e8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:39.264969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d5402541-4a05-4a6b-ba19-eef856e5d1e8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:39.265617 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d5402541-4a05-4a6b-ba19-eef856e5d1e8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:39.569705 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d5402541-4a05-4a6b-ba19-eef856e5d1e8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:39.578086 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-d5402541-4a05-4a6b-ba19-eef856e5d1e8 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1751 microversion: 2.1 time: 0.327434 Jul 20 15:36:39.578725 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 262/523] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:39 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1751 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:36:40.428520 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-6a03686c-9207-4f6b-8df3-1018bd2aeeef req-7c3b4b51-7e59-49d7-88b6-58bed22b7f87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "562e58cb-a1c0-4582-b4aa-46abf6053c11", "tag": "5dcfcdca-0e07-4def-8734-604f0229a302"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:36:40.441256 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-6a03686c-9207-4f6b-8df3-1018bd2aeeef req-7c3b4b51-7e59-49d7-88b6-58bed22b7f87 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:40.441938 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-6a03686c-9207-4f6b-8df3-1018bd2aeeef req-7c3b4b51-7e59-49d7-88b6-58bed22b7f87 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:40.457496 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-6a03686c-9207-4f6b-8df3-1018bd2aeeef req-7c3b4b51-7e59-49d7-88b6-58bed22b7f87 service nova] Creating event network-changed:5dcfcdca-0e07-4def-8734-604f0229a302 for instance 562e58cb-a1c0-4582-b4aa-46abf6053c11 on hv-cinder-81914 Jul 20 15:36:40.465951 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-6a03686c-9207-4f6b-8df3-1018bd2aeeef req-7c3b4b51-7e59-49d7-88b6-58bed22b7f87 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043325 Jul 20 15:36:40.467272 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 262/524] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:36:40.601880 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-30abb063-3835-4652-880a-18d7f3050077 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:40.602891 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-30abb063-3835-4652-880a-18d7f3050077 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:40.612326 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-30abb063-3835-4652-880a-18d7f3050077 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:40.612773 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-30abb063-3835-4652-880a-18d7f3050077 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:40.613553 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-30abb063-3835-4652-880a-18d7f3050077 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:40.613983 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-30abb063-3835-4652-880a-18d7f3050077 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:40.851477 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-30abb063-3835-4652-880a-18d7f3050077 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:40.861073 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-30abb063-3835-4652-880a-18d7f3050077 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1756 microversion: 2.1 time: 0.266843 Jul 20 15:36:40.874456 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 263/525] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:40 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1756 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:41.884736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-aa88f984-e5d3-4df1-9b40-660cded5253d tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:41.885770 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-aa88f984-e5d3-4df1-9b40-660cded5253d tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:41.893629 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-aa88f984-e5d3-4df1-9b40-660cded5253d tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:41.894158 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-aa88f984-e5d3-4df1-9b40-660cded5253d tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:41.895049 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-aa88f984-e5d3-4df1-9b40-660cded5253d tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:41.895614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-aa88f984-e5d3-4df1-9b40-660cded5253d tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:42.083910 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-aa88f984-e5d3-4df1-9b40-660cded5253d tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:42.093075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-aa88f984-e5d3-4df1-9b40-660cded5253d tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1756 microversion: 2.1 time: 0.214449 Jul 20 15:36:42.093669 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 263/526] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:41 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1756 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:43.112414 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-ddb28aba-c35b-42a0-91e0-6802d9e37173 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:43.113453 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-ddb28aba-c35b-42a0-91e0-6802d9e37173 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:43.123100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ddb28aba-c35b-42a0-91e0-6802d9e37173 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:43.123552 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ddb28aba-c35b-42a0-91e0-6802d9e37173 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:43.124349 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ddb28aba-c35b-42a0-91e0-6802d9e37173 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:43.124785 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ddb28aba-c35b-42a0-91e0-6802d9e37173 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:43.283655 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-ddb28aba-c35b-42a0-91e0-6802d9e37173 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:43.292591 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-ddb28aba-c35b-42a0-91e0-6802d9e37173 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1756 microversion: 2.1 time: 0.186239 Jul 20 15:36:43.297272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 264/527] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:43 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:44.309675 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-a85f2da7-ac05-424e-88f5-004dffd2fea6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:44.310768 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-a85f2da7-ac05-424e-88f5-004dffd2fea6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:44.317650 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a85f2da7-ac05-424e-88f5-004dffd2fea6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:44.318103 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a85f2da7-ac05-424e-88f5-004dffd2fea6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:44.319042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a85f2da7-ac05-424e-88f5-004dffd2fea6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:44.325295 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a85f2da7-ac05-424e-88f5-004dffd2fea6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:44.537678 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-a85f2da7-ac05-424e-88f5-004dffd2fea6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:44.546367 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-a85f2da7-ac05-424e-88f5-004dffd2fea6 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1756 microversion: 2.1 time: 0.240600 Jul 20 15:36:44.546988 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 264/528] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:44 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1756 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:36:44.730625 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-ad751aaf-159d-4266-b0c3-ad038150f18d tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:44.731116 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-ad751aaf-159d-4266-b0c3-ad038150f18d tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:44.738391 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ad751aaf-159d-4266-b0c3-ad038150f18d tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:44.738836 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ad751aaf-159d-4266-b0c3-ad038150f18d tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:44.739596 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ad751aaf-159d-4266-b0c3-ad038150f18d tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:44.740028 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ad751aaf-159d-4266-b0c3-ad038150f18d tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:44.825181 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.objects.instance [None req-ad751aaf-159d-4266-b0c3-ad038150f18d tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lazy-loading 'services' on Instance uuid 6854fb03-c976-4d6f-88ff-8060777c67bc {{(pid=124712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:36:45.081270 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-ad751aaf-159d-4266-b0c3-ad038150f18d tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc/os-volume_attachments/543b082b-2efc-43dd-98a5-52a5aaa169c3" status: 202 len: 0 microversion: 2.1 time: 0.355196 Jul 20 15:36:45.081869 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 265/529] 10.222.0.78 () {58 vars in 1415 bytes} [Wed Jul 20 15:36:44 2022] DELETE /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc/os-volume_attachments/543b082b-2efc-43dd-98a5-52a5aaa169c3 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:36:45.565300 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-9b488c26-0150-4820-9b5b-da508faaee3c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:45.566520 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-9b488c26-0150-4820-9b5b-da508faaee3c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:45.573563 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9b488c26-0150-4820-9b5b-da508faaee3c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:45.574310 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9b488c26-0150-4820-9b5b-da508faaee3c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:45.575063 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9b488c26-0150-4820-9b5b-da508faaee3c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:45.575611 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9b488c26-0150-4820-9b5b-da508faaee3c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:45.728565 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-9b488c26-0150-4820-9b5b-da508faaee3c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:45.737484 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-9b488c26-0150-4820-9b5b-da508faaee3c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1756 microversion: 2.1 time: 0.177310 Jul 20 15:36:45.738064 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 265/530] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:45 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:46.756508 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-515b9fe3-ca17-423f-99fc-87ce8f7b29c1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:46.757126 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-515b9fe3-ca17-423f-99fc-87ce8f7b29c1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:46.767410 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-515b9fe3-ca17-423f-99fc-87ce8f7b29c1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:46.767410 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-515b9fe3-ca17-423f-99fc-87ce8f7b29c1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:46.767410 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-515b9fe3-ca17-423f-99fc-87ce8f7b29c1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:46.767410 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-515b9fe3-ca17-423f-99fc-87ce8f7b29c1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:46.772681 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:46.923149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-515b9fe3-ca17-423f-99fc-87ce8f7b29c1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:46.931819 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-515b9fe3-ca17-423f-99fc-87ce8f7b29c1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1756 microversion: 2.1 time: 0.180200 Jul 20 15:36:46.932393 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 266/531] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:46 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:47.262405 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-84ab1157-894b-49e3-8baf-f8b842099e26 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:47.263111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-84ab1157-894b-49e3-8baf-f8b842099e26 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:47.269595 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-84ab1157-894b-49e3-8baf-f8b842099e26 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:47.270042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-84ab1157-894b-49e3-8baf-f8b842099e26 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:47.270833 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-84ab1157-894b-49e3-8baf-f8b842099e26 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:47.271388 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-84ab1157-894b-49e3-8baf-f8b842099e26 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:47.298235 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-84ab1157-894b-49e3-8baf-f8b842099e26 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Going to try to terminate instance {{(pid=124711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 15:36:47.658245 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-84ab1157-894b-49e3-8baf-f8b842099e26 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 204 len: 0 microversion: 2.1 time: 0.399499 Jul 20 15:36:47.658871 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 266/532] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:36:47 2022] DELETE /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 15:36:47.668009 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d0c9ea3d-71ca-466f-a83e-f5125a7f29b0 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:47.671228 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d0c9ea3d-71ca-466f-a83e-f5125a7f29b0 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:47.675097 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d0c9ea3d-71ca-466f-a83e-f5125a7f29b0 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:47.675352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d0c9ea3d-71ca-466f-a83e-f5125a7f29b0 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:47.676147 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d0c9ea3d-71ca-466f-a83e-f5125a7f29b0 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:47.676701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d0c9ea3d-71ca-466f-a83e-f5125a7f29b0 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:47.820343 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d0c9ea3d-71ca-466f-a83e-f5125a7f29b0 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:47.830884 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-d0c9ea3d-71ca-466f-a83e-f5125a7f29b0 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 200 len: 1514 microversion: 2.1 time: 0.166958 Jul 20 15:36:47.831568 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 267/533] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:47 2022] GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:47.950709 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c05536a2-7717-4cc0-93a1-c38ebfdf4340 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:47.951856 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c05536a2-7717-4cc0-93a1-c38ebfdf4340 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:47.957782 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c05536a2-7717-4cc0-93a1-c38ebfdf4340 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:47.958219 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c05536a2-7717-4cc0-93a1-c38ebfdf4340 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:47.959028 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c05536a2-7717-4cc0-93a1-c38ebfdf4340 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:47.959687 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c05536a2-7717-4cc0-93a1-c38ebfdf4340 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:48.114472 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c05536a2-7717-4cc0-93a1-c38ebfdf4340 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:48.116838 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:48.124708 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c05536a2-7717-4cc0-93a1-c38ebfdf4340 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1756 microversion: 2.1 time: 0.178394 Jul 20 15:36:48.125299 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 267/534] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:47 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:48.849094 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-5056ede2-3040-4355-8bb7-36899349fb81 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:48.849691 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-5056ede2-3040-4355-8bb7-36899349fb81 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:48.856465 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5056ede2-3040-4355-8bb7-36899349fb81 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:48.858108 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5056ede2-3040-4355-8bb7-36899349fb81 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:48.858528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5056ede2-3040-4355-8bb7-36899349fb81 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:48.858853 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5056ede2-3040-4355-8bb7-36899349fb81 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:48.995445 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-5056ede2-3040-4355-8bb7-36899349fb81 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:49.004869 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-5056ede2-3040-4355-8bb7-36899349fb81 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 200 len: 1514 microversion: 2.1 time: 0.159950 Jul 20 15:36:49.005449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 268/535] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:48 2022] GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:49.143430 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-549870e9-ca7e-4cfe-ad24-5d1d14992d7c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:49.144175 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-549870e9-ca7e-4cfe-ad24-5d1d14992d7c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:49.157398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-549870e9-ca7e-4cfe-ad24-5d1d14992d7c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:49.166009 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-549870e9-ca7e-4cfe-ad24-5d1d14992d7c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:49.166009 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-549870e9-ca7e-4cfe-ad24-5d1d14992d7c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:49.166009 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-549870e9-ca7e-4cfe-ad24-5d1d14992d7c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:49.320331 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-549870e9-ca7e-4cfe-ad24-5d1d14992d7c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:49.329262 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-549870e9-ca7e-4cfe-ad24-5d1d14992d7c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1756 microversion: 2.1 time: 0.190739 Jul 20 15:36:49.331690 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 268/536] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:49 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:50.022800 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-c2b7d3ac-9770-4f9b-be03-fa01ae121226 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:50.023485 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-c2b7d3ac-9770-4f9b-be03-fa01ae121226 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:50.032287 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c2b7d3ac-9770-4f9b-be03-fa01ae121226 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:50.033105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c2b7d3ac-9770-4f9b-be03-fa01ae121226 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:50.039342 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c2b7d3ac-9770-4f9b-be03-fa01ae121226 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:50.039342 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c2b7d3ac-9770-4f9b-be03-fa01ae121226 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:50.183456 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-c2b7d3ac-9770-4f9b-be03-fa01ae121226 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:50.192573 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-c2b7d3ac-9770-4f9b-be03-fa01ae121226 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 200 len: 1514 microversion: 2.1 time: 0.173462 Jul 20 15:36:50.193177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 269/537] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:50 2022] GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:50.349963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-636d8a07-934e-456a-aa12-7b8dc3697185 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:50.350589 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-636d8a07-934e-456a-aa12-7b8dc3697185 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:50.358363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-636d8a07-934e-456a-aa12-7b8dc3697185 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:50.358807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-636d8a07-934e-456a-aa12-7b8dc3697185 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:50.359779 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-636d8a07-934e-456a-aa12-7b8dc3697185 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:50.360209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-636d8a07-934e-456a-aa12-7b8dc3697185 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:50.521472 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-636d8a07-934e-456a-aa12-7b8dc3697185 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:50.533569 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-636d8a07-934e-456a-aa12-7b8dc3697185 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1756 microversion: 2.1 time: 0.187208 Jul 20 15:36:50.533676 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 269/538] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:50 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:36:50.548124 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-33e62501-3d3e-4374-9ec7-6ab2acabb971 req-fabf48c8-74d7-4c09-92c8-2d30110177e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6854fb03-c976-4d6f-88ff-8060777c67bc", "name": "network-vif-deleted", "tag": "5ea8bb63-cd9c-4e67-8488-ff3991760128"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:36:50.556777 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-33e62501-3d3e-4374-9ec7-6ab2acabb971 req-fabf48c8-74d7-4c09-92c8-2d30110177e1 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:50.557206 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-33e62501-3d3e-4374-9ec7-6ab2acabb971 req-fabf48c8-74d7-4c09-92c8-2d30110177e1 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:50.569198 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-33e62501-3d3e-4374-9ec7-6ab2acabb971 req-fabf48c8-74d7-4c09-92c8-2d30110177e1 service nova] Creating event network-vif-deleted:5ea8bb63-cd9c-4e67-8488-ff3991760128 for instance 6854fb03-c976-4d6f-88ff-8060777c67bc on hv-cinder-81914 Jul 20 15:36:50.574836 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-33e62501-3d3e-4374-9ec7-6ab2acabb971 req-fabf48c8-74d7-4c09-92c8-2d30110177e1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031008 Jul 20 15:36:50.576191 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 270/539] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:36:51.222902 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-9cd2e8f3-c6c1-4d95-86b7-aeecda193ab3 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:51.222902 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-9cd2e8f3-c6c1-4d95-86b7-aeecda193ab3 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:51.222902 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9cd2e8f3-c6c1-4d95-86b7-aeecda193ab3 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:51.222902 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9cd2e8f3-c6c1-4d95-86b7-aeecda193ab3 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:51.223332 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9cd2e8f3-c6c1-4d95-86b7-aeecda193ab3 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:51.223332 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9cd2e8f3-c6c1-4d95-86b7-aeecda193ab3 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:51.254196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9cd2e8f3-c6c1-4d95-86b7-aeecda193ab3 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:51.254669 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9cd2e8f3-c6c1-4d95-86b7-aeecda193ab3 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:51.255119 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.objects.instance [None req-9cd2e8f3-c6c1-4d95-86b7-aeecda193ab3 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lazy-loading 'fault' on Instance uuid 6854fb03-c976-4d6f-88ff-8060777c67bc {{(pid=124711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:36:51.300452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-9cd2e8f3-c6c1-4d95-86b7-aeecda193ab3 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:51.308330 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-9cd2e8f3-c6c1-4d95-86b7-aeecda193ab3 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 200 len: 1309 microversion: 2.1 time: 0.099615 Jul 20 15:36:51.308914 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 270/540] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:51 2022] GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:51.552255 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-a808dce8-4c9d-4f00-aca5-41791b431fbd tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:51.553053 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-a808dce8-4c9d-4f00-aca5-41791b431fbd tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:51.560029 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a808dce8-4c9d-4f00-aca5-41791b431fbd tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:51.560482 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a808dce8-4c9d-4f00-aca5-41791b431fbd tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:51.561251 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a808dce8-4c9d-4f00-aca5-41791b431fbd tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:51.561686 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a808dce8-4c9d-4f00-aca5-41791b431fbd tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:51.719380 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-a808dce8-4c9d-4f00-aca5-41791b431fbd tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:51.729557 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-a808dce8-4c9d-4f00-aca5-41791b431fbd tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1756 microversion: 2.1 time: 0.181531 Jul 20 15:36:51.734400 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 271/541] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:51 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:52.327425 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ec1ee3c3-81e3-43c0-9016-a7db0b2a389b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:52.328070 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ec1ee3c3-81e3-43c0-9016-a7db0b2a389b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: 6854fb03-c976-4d6f-88ff-8060777c67bc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:52.336158 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ec1ee3c3-81e3-43c0-9016-a7db0b2a389b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:52.336604 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ec1ee3c3-81e3-43c0-9016-a7db0b2a389b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:52.337374 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ec1ee3c3-81e3-43c0-9016-a7db0b2a389b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:52.337825 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ec1ee3c3-81e3-43c0-9016-a7db0b2a389b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:52.352376 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-ec1ee3c3-81e3-43c0-9016-a7db0b2a389b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] HTTP exception thrown: Instance 6854fb03-c976-4d6f-88ff-8060777c67bc could not be found. Jul 20 15:36:52.353952 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ec1ee3c3-81e3-43c0-9016-a7db0b2a389b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Request method failure captured: Jul 20 15:36:52.353952 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc HTTP/1.1 Jul 20 15:36:52.353952 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:36:52.353952 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:36:52.353952 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:36:52.353952 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:36:52.353952 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:36:52.353952 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:36:52.353952 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:36:52.353952 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:36:52.353952 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2CC-6bl2h8BuqiXXXl0RaTNVuWc7LSRZZzXC416pMusaF1ou9I1ajDDYyW4TV7G0mi0SqaRGIjMy5HCU0Cjk9_fEMwbfHxtoeURXI_3k9HClo6swy_rGHL6f7p-Rwwb68I6aHENNuN79olu5GqY8qzJaruZJGC-0UaZIviRY4q-fyoM Jul 20 15:36:52.353952 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:36:52.353952 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:36:52.353952 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:36:52.353952 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:36:52.353952 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:36:52.353952 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:36:52.353952 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: 3e3b499bb69b4b449a2e2515d94094fb Jul 20 15:36:52.353952 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1089502414 Jul 20 15:36:52.353952 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:36:52.353952 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:36:52.355654 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3e3b499bb69b4b449a2e2515d94094fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3e3b499bb69b4b449a2e2515d94094fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3e3b499bb69b4b449a2e2515d94094fb", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3e3b499bb69b4b449a2e2515d94094fb"}]}] Jul 20 15:36:52.355654 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-VolumesSnapshotTestJSON-1089502414 Jul 20 15:36:52.355654 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: 3e3b499bb69b4b449a2e2515d94094fb Jul 20 15:36:52.355654 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1089502414 Jul 20 15:36:52.355654 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-VolumesSnapshotTestJSON-1089502414-project Jul 20 15:36:52.355654 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:36:52.355654 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:36:52.355654 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: 9ea2abd1398f4fba93b3b7a5beb52ba0 Jul 20 15:36:52.355654 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-VolumesSnapshotTestJSON-1089502414-project Jul 20 15:36:52.355654 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: > Jul 20 15:36:52.355654 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Instance 6854fb03-c976-4d6f-88ff-8060777c67bc could not be found. Jul 20 15:36:52.355654 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': '6854fb03-c976-4d6f-88ff-8060777c67bc'} Jul 20 15:36:52.356665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:36:52.356665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:36:52.356665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:36:52.356665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:36:52.356665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:36:52.356665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:36:52.356665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:36:52.356665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:36:52.356665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:36:52.356665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:36:52.356665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6854fb03-c976-4d6f-88ff-8060777c67bc could not be found. Jul 20 15:36:52.356665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:36:52.356665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:36:52.356665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:36:52.356665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:36:52.356665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:36:52.356665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:36:52.356665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:36:52.356665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:36:52.356665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:36:52.358168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:36:52.358168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:36:52.358168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:36:52.358168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:36:52.358168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:36:52.358168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:36:52.358168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:36:52.358168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6854fb03-c976-4d6f-88ff-8060777c67bc could not be found. Jul 20 15:36:52.358168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:36:52.358168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:36:52.358168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:36:52.358168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:36:52.358168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:36:52.358168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:36:52.358168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:36:52.358168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:36:52.358168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6854fb03-c976-4d6f-88ff-8060777c67bc could not be found. Jul 20 15:36:52.358168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:36:52.363772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ec1ee3c3-81e3-43c0-9016-a7db0b2a389b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Returning 404 to user: Instance 6854fb03-c976-4d6f-88ff-8060777c67bc could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:36:52.363772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-ec1ee3c3-81e3-43c0-9016-a7db0b2a389b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc" status: 404 len: 111 microversion: 2.1 time: 0.032589 Jul 20 15:36:52.363772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 271/542] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:52 2022] GET /compute/v2.1/servers/6854fb03-c976-4d6f-88ff-8060777c67bc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:36:52.750518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-3669893c-9348-4243-b3ea-9d64a871137e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:52.751115 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-3669893c-9348-4243-b3ea-9d64a871137e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:52.759038 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3669893c-9348-4243-b3ea-9d64a871137e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:52.763168 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3669893c-9348-4243-b3ea-9d64a871137e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:52.763168 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3669893c-9348-4243-b3ea-9d64a871137e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:52.763168 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3669893c-9348-4243-b3ea-9d64a871137e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:52.935400 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-7315b493-21cb-459a-8b9b-1776cf455df1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:52.936501 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-7315b493-21cb-459a-8b9b-1776cf455df1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:52.942874 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7315b493-21cb-459a-8b9b-1776cf455df1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:52.943401 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7315b493-21cb-459a-8b9b-1776cf455df1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:52.944229 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7315b493-21cb-459a-8b9b-1776cf455df1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:52.944559 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-3669893c-9348-4243-b3ea-9d64a871137e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:52.944724 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7315b493-21cb-459a-8b9b-1776cf455df1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:52.954031 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-3669893c-9348-4243-b3ea-9d64a871137e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1756 microversion: 2.1 time: 0.208395 Jul 20 15:36:52.954629 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 272/543] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:52 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1756 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:52.987262 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-7315b493-21cb-459a-8b9b-1776cf455df1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/os-volume_attachments/9d6996f4-618c-4372-9955-de43a3b8717f" status: 200 len: 194 microversion: 2.20 time: 0.055842 Jul 20 15:36:52.988087 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 272/544] 10.222.0.78 () {60 vars in 1453 bytes} [Wed Jul 20 15:36:52 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/os-volume_attachments/9d6996f4-618c-4372-9955-de43a3b8717f => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 15:36:53.055342 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d40132a1-d268-4a2f-beb9-3961d99bc7cd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:53.060555 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d40132a1-d268-4a2f-beb9-3961d99bc7cd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:53.062101 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d40132a1-d268-4a2f-beb9-3961d99bc7cd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:53.062585 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d40132a1-d268-4a2f-beb9-3961d99bc7cd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:53.063730 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d40132a1-d268-4a2f-beb9-3961d99bc7cd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:53.063852 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d40132a1-d268-4a2f-beb9-3961d99bc7cd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:53.167883 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.objects.instance [None req-d40132a1-d268-4a2f-beb9-3961d99bc7cd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lazy-loading 'services' on Instance uuid f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 {{(pid=124712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:36:53.422619 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-d40132a1-d268-4a2f-beb9-3961d99bc7cd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/os-volume_attachments/9d6996f4-618c-4372-9955-de43a3b8717f" status: 202 len: 0 microversion: 2.20 time: 0.370844 Jul 20 15:36:53.423455 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 273/545] 10.222.0.78 () {60 vars in 1456 bytes} [Wed Jul 20 15:36:53 2022] DELETE /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/os-volume_attachments/9d6996f4-618c-4372-9955-de43a3b8717f => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 15:36:53.433465 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-2f8bb5e7-d359-4616-99e0-498d42bb94de tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:53.436352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-2f8bb5e7-d359-4616-99e0-498d42bb94de tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:53.441428 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2f8bb5e7-d359-4616-99e0-498d42bb94de tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:53.441875 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2f8bb5e7-d359-4616-99e0-498d42bb94de tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:53.442689 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2f8bb5e7-d359-4616-99e0-498d42bb94de tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:53.443129 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2f8bb5e7-d359-4616-99e0-498d42bb94de tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:53.476306 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-2f8bb5e7-d359-4616-99e0-498d42bb94de tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047184 Jul 20 15:36:53.476923 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 273/546] 10.222.0.78 () {60 vars in 1342 bytes} [Wed Jul 20 15:36:53 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 15:36:53.973690 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-75d8b188-78d7-490c-b642-4a9877370510 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:53.974468 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-75d8b188-78d7-490c-b642-4a9877370510 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:53.981321 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-75d8b188-78d7-490c-b642-4a9877370510 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:53.981840 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-75d8b188-78d7-490c-b642-4a9877370510 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:53.982646 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-75d8b188-78d7-490c-b642-4a9877370510 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:53.983084 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-75d8b188-78d7-490c-b642-4a9877370510 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:54.157558 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-75d8b188-78d7-490c-b642-4a9877370510 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:54.166047 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-75d8b188-78d7-490c-b642-4a9877370510 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1756 microversion: 2.1 time: 0.197529 Jul 20 15:36:54.166652 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 274/547] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:53 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:36:54.489086 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-7186b7c0-273f-4302-88ad-b17fe543ee97 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:54.489984 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-7186b7c0-273f-4302-88ad-b17fe543ee97 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:54.496581 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7186b7c0-273f-4302-88ad-b17fe543ee97 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:54.497024 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7186b7c0-273f-4302-88ad-b17fe543ee97 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:54.498448 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7186b7c0-273f-4302-88ad-b17fe543ee97 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:54.498876 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7186b7c0-273f-4302-88ad-b17fe543ee97 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:54.531429 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-7186b7c0-273f-4302-88ad-b17fe543ee97 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046345 Jul 20 15:36:54.532026 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 274/548] 10.222.0.78 () {60 vars in 1342 bytes} [Wed Jul 20 15:36:54 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 15:36:55.185027 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-af68a473-2ce9-4c82-a055-1f0b7d6a6f8c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:55.185620 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-af68a473-2ce9-4c82-a055-1f0b7d6a6f8c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:55.192414 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-af68a473-2ce9-4c82-a055-1f0b7d6a6f8c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:55.192864 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-af68a473-2ce9-4c82-a055-1f0b7d6a6f8c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:55.193629 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-af68a473-2ce9-4c82-a055-1f0b7d6a6f8c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:55.194056 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-af68a473-2ce9-4c82-a055-1f0b7d6a6f8c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:55.344651 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-af68a473-2ce9-4c82-a055-1f0b7d6a6f8c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:55.355803 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-af68a473-2ce9-4c82-a055-1f0b7d6a6f8c tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1756 microversion: 2.1 time: 0.174507 Jul 20 15:36:55.356396 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 275/549] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:55 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:55.543458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-4e52c16c-d500-4c6b-a290-ae0acfc35723 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:55.544365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-4e52c16c-d500-4c6b-a290-ae0acfc35723 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:55.550861 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4e52c16c-d500-4c6b-a290-ae0acfc35723 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:55.551333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4e52c16c-d500-4c6b-a290-ae0acfc35723 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:55.552095 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4e52c16c-d500-4c6b-a290-ae0acfc35723 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:55.552528 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4e52c16c-d500-4c6b-a290-ae0acfc35723 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:55.586221 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-4e52c16c-d500-4c6b-a290-ae0acfc35723 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045836 Jul 20 15:36:55.586221 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 275/550] 10.222.0.78 () {60 vars in 1342 bytes} [Wed Jul 20 15:36:55 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 15:36:56.376521 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-c73bdb4a-00b1-442b-bddc-a10eb691ced4 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:56.377402 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-c73bdb4a-00b1-442b-bddc-a10eb691ced4 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:56.385261 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c73bdb4a-00b1-442b-bddc-a10eb691ced4 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:56.385828 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c73bdb4a-00b1-442b-bddc-a10eb691ced4 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:56.386880 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c73bdb4a-00b1-442b-bddc-a10eb691ced4 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:56.387420 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c73bdb4a-00b1-442b-bddc-a10eb691ced4 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:56.462461 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-df401280-4c5a-4c3c-a8ce-cf15d57f94d1 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:56.463404 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-df401280-4c5a-4c3c-a8ce-cf15d57f94d1 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:56.465269 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:56.470863 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-df401280-4c5a-4c3c-a8ce-cf15d57f94d1 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:56.472260 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-df401280-4c5a-4c3c-a8ce-cf15d57f94d1 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:56.472260 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-df401280-4c5a-4c3c-a8ce-cf15d57f94d1 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:56.472818 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-df401280-4c5a-4c3c-a8ce-cf15d57f94d1 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:56.506589 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-df401280-4c5a-4c3c-a8ce-cf15d57f94d1 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048380 Jul 20 15:36:56.507082 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 276/551] 10.222.0.78 () {58 vars in 1301 bytes} [Wed Jul 20 15:36:56 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 15:36:56.551559 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-c73bdb4a-00b1-442b-bddc-a10eb691ced4 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:56.569924 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-c73bdb4a-00b1-442b-bddc-a10eb691ced4 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1756 microversion: 2.1 time: 0.200147 Jul 20 15:36:56.571397 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 276/552] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:56 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:56.572163 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-cfa74944-2e9c-4935-ab95-7c41db9f4213 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:56.572675 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-cfa74944-2e9c-4935-ab95-7c41db9f4213 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:56.580137 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cfa74944-2e9c-4935-ab95-7c41db9f4213 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:56.580585 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cfa74944-2e9c-4935-ab95-7c41db9f4213 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:56.581427 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cfa74944-2e9c-4935-ab95-7c41db9f4213 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:56.581868 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cfa74944-2e9c-4935-ab95-7c41db9f4213 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:56.605261 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-0983329d-2967-4dd4-bee5-b9f481c791ea tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:56.606820 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-0983329d-2967-4dd4-bee5-b9f481c791ea tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:56.616142 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0983329d-2967-4dd4-bee5-b9f481c791ea tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:56.616860 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0983329d-2967-4dd4-bee5-b9f481c791ea tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:56.618061 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0983329d-2967-4dd4-bee5-b9f481c791ea tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:56.618801 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0983329d-2967-4dd4-bee5-b9f481c791ea tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:56.619937 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-cfa74944-2e9c-4935-ab95-7c41db9f4213 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Going to try to terminate instance {{(pid=124711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 15:36:56.669322 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-0983329d-2967-4dd4-bee5-b9f481c791ea tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070631 Jul 20 15:36:56.670279 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 277/553] 10.222.0.78 () {60 vars in 1342 bytes} [Wed Jul 20 15:36:56 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 15:36:57.018363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-cfa74944-2e9c-4935-ab95-7c41db9f4213 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 204 len: 0 microversion: 2.1 time: 0.449923 Jul 20 15:36:57.022422 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 277/554] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:36:56 2022] DELETE /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 15:36:57.028120 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e5dc2d6b-9c99-4702-b695-5903783e5c2e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:57.029930 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e5dc2d6b-9c99-4702-b695-5903783e5c2e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:57.036998 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e5dc2d6b-9c99-4702-b695-5903783e5c2e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:57.042778 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e5dc2d6b-9c99-4702-b695-5903783e5c2e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:57.042778 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e5dc2d6b-9c99-4702-b695-5903783e5c2e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:57.042778 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e5dc2d6b-9c99-4702-b695-5903783e5c2e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:57.205906 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-e5dc2d6b-9c99-4702-b695-5903783e5c2e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:57.214042 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-e5dc2d6b-9c99-4702-b695-5903783e5c2e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1673 microversion: 2.1 time: 0.190262 Jul 20 15:36:57.214658 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 278/555] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:57 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1673 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:57.589313 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-cb487492-a08d-41ab-9655-b983928ac169 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:57.589920 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-cb487492-a08d-41ab-9655-b983928ac169 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:57.597225 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cb487492-a08d-41ab-9655-b983928ac169 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:57.597536 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cb487492-a08d-41ab-9655-b983928ac169 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:57.598333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cb487492-a08d-41ab-9655-b983928ac169 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:57.598771 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cb487492-a08d-41ab-9655-b983928ac169 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:57.758523 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-cb487492-a08d-41ab-9655-b983928ac169 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:57.767038 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-cb487492-a08d-41ab-9655-b983928ac169 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1759 microversion: 2.1 time: 0.182060 Jul 20 15:36:57.767620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 278/556] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:57 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1759 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:57.807255 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-5677d935-6394-4293-8918-21b2fc9bdf35 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:57.808237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-5677d935-6394-4293-8918-21b2fc9bdf35 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:57.814588 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5677d935-6394-4293-8918-21b2fc9bdf35 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:57.815520 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5677d935-6394-4293-8918-21b2fc9bdf35 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:57.815828 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5677d935-6394-4293-8918-21b2fc9bdf35 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:57.816260 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5677d935-6394-4293-8918-21b2fc9bdf35 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:57.850103 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-5677d935-6394-4293-8918-21b2fc9bdf35 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.165776 Jul 20 15:36:57.850103 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 279/557] 10.222.0.78 () {60 vars in 1342 bytes} [Wed Jul 20 15:36:57 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6/os-volume_attachments => generated 25 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:36:57.912412 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-3d0b695e-6836-4a14-81b0-8698b81277b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:57.912898 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-3d0b695e-6836-4a14-81b0-8698b81277b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:57.919365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3d0b695e-6836-4a14-81b0-8698b81277b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:57.919812 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3d0b695e-6836-4a14-81b0-8698b81277b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:57.920564 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3d0b695e-6836-4a14-81b0-8698b81277b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:57.920994 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3d0b695e-6836-4a14-81b0-8698b81277b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:57.946064 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-3d0b695e-6836-4a14-81b0-8698b81277b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Going to try to terminate instance {{(pid=124711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 15:36:58.231345 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-6dd37be3-b574-4dc9-86a1-36d5bf59314f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:58.231985 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-6dd37be3-b574-4dc9-86a1-36d5bf59314f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:58.237812 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6dd37be3-b574-4dc9-86a1-36d5bf59314f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:58.238280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6dd37be3-b574-4dc9-86a1-36d5bf59314f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:58.239071 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6dd37be3-b574-4dc9-86a1-36d5bf59314f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:58.239523 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6dd37be3-b574-4dc9-86a1-36d5bf59314f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:58.376849 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-6dd37be3-b574-4dc9-86a1-36d5bf59314f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:58.384525 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-6dd37be3-b574-4dc9-86a1-36d5bf59314f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1673 microversion: 2.1 time: 0.157083 Jul 20 15:36:58.385080 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 280/558] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:58 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:36:58.412441 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-3d0b695e-6836-4a14-81b0-8698b81277b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 204 len: 0 microversion: 2.20 time: 0.503893 Jul 20 15:36:58.413019 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 279/559] 10.222.0.78 () {60 vars in 1279 bytes} [Wed Jul 20 15:36:57 2022] DELETE /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 15:36:58.421867 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-fd14363f-380c-4755-9754-2b12d9337fc3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:58.427672 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-fd14363f-380c-4755-9754-2b12d9337fc3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:58.429053 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fd14363f-380c-4755-9754-2b12d9337fc3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:58.429497 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fd14363f-380c-4755-9754-2b12d9337fc3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:58.430251 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fd14363f-380c-4755-9754-2b12d9337fc3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:58.430705 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fd14363f-380c-4755-9754-2b12d9337fc3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:58.569759 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-fd14363f-380c-4755-9754-2b12d9337fc3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:58.577368 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-fd14363f-380c-4755-9754-2b12d9337fc3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:58.578924 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-fd14363f-380c-4755-9754-2b12d9337fc3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:58.580083 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-fd14363f-380c-4755-9754-2b12d9337fc3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.162697 Jul 20 15:36:58.580646 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 281/560] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:36:58 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:36:59.403469 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-cd6c9a24-af56-4b43-be37-5606265f6c78 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:59.404734 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-cd6c9a24-af56-4b43-be37-5606265f6c78 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:59.411489 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cd6c9a24-af56-4b43-be37-5606265f6c78 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:59.411935 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cd6c9a24-af56-4b43-be37-5606265f6c78 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:59.412707 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cd6c9a24-af56-4b43-be37-5606265f6c78 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:59.413141 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cd6c9a24-af56-4b43-be37-5606265f6c78 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:59.547547 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-cd6c9a24-af56-4b43-be37-5606265f6c78 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:59.555501 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-cd6c9a24-af56-4b43-be37-5606265f6c78 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1673 microversion: 2.1 time: 0.156314 Jul 20 15:36:59.556076 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 280/561] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:36:59 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:36:59.599062 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-0fa61235-ddd4-4db0-b690-92596c5eaa70 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:36:59.599665 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-0fa61235-ddd4-4db0-b690-92596c5eaa70 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:36:59.606502 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0fa61235-ddd4-4db0-b690-92596c5eaa70 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:59.608050 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0fa61235-ddd4-4db0-b690-92596c5eaa70 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:59.608807 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0fa61235-ddd4-4db0-b690-92596c5eaa70 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:36:59.609234 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0fa61235-ddd4-4db0-b690-92596c5eaa70 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:36:59.751701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-0fa61235-ddd4-4db0-b690-92596c5eaa70 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:59.754254 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:36:59.760958 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-0fa61235-ddd4-4db0-b690-92596c5eaa70 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:59.762498 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-0fa61235-ddd4-4db0-b690-92596c5eaa70 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:36:59.764183 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-0fa61235-ddd4-4db0-b690-92596c5eaa70 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.168985 Jul 20 15:36:59.764744 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 282/562] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:36:59 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:37:00.573697 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-688d65ab-acfa-4457-8c98-f4da7526da9a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:00.574398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-688d65ab-acfa-4457-8c98-f4da7526da9a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:00.581644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-688d65ab-acfa-4457-8c98-f4da7526da9a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:00.582196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-688d65ab-acfa-4457-8c98-f4da7526da9a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:00.582991 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-688d65ab-acfa-4457-8c98-f4da7526da9a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:00.583421 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-688d65ab-acfa-4457-8c98-f4da7526da9a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:00.599905 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:00.724290 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-688d65ab-acfa-4457-8c98-f4da7526da9a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:00.732551 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-688d65ab-acfa-4457-8c98-f4da7526da9a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1673 microversion: 2.1 time: 0.162511 Jul 20 15:37:00.733137 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 281/563] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:00 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:37:00.783310 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-57f924a5-1f93-4e67-9a58-d4240d173ff5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:00.783913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-57f924a5-1f93-4e67-9a58-d4240d173ff5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:00.791107 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-57f924a5-1f93-4e67-9a58-d4240d173ff5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:00.791553 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-57f924a5-1f93-4e67-9a58-d4240d173ff5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:00.792377 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-57f924a5-1f93-4e67-9a58-d4240d173ff5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:00.792805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-57f924a5-1f93-4e67-9a58-d4240d173ff5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:00.936345 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-57f924a5-1f93-4e67-9a58-d4240d173ff5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:00.950993 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-57f924a5-1f93-4e67-9a58-d4240d173ff5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:00.953468 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-57f924a5-1f93-4e67-9a58-d4240d173ff5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:00.955617 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-57f924a5-1f93-4e67-9a58-d4240d173ff5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.176573 Jul 20 15:37:00.956617 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 283/564] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:00 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:37:01.749780 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-08e27071-afe6-4167-a197-e2b429643c88 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:01.750449 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-08e27071-afe6-4167-a197-e2b429643c88 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:01.757683 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-08e27071-afe6-4167-a197-e2b429643c88 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:01.770674 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-08e27071-afe6-4167-a197-e2b429643c88 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:01.770674 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-08e27071-afe6-4167-a197-e2b429643c88 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:01.770674 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-08e27071-afe6-4167-a197-e2b429643c88 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:01.889041 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-08e27071-afe6-4167-a197-e2b429643c88 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:01.896551 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-08e27071-afe6-4167-a197-e2b429643c88 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1673 microversion: 2.1 time: 0.150642 Jul 20 15:37:01.897119 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 282/565] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:01 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:01.983770 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-98b4cdb5-da5b-4833-b5ce-59e7e35baf23 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:01.984367 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-98b4cdb5-da5b-4833-b5ce-59e7e35baf23 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:01.991093 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-98b4cdb5-da5b-4833-b5ce-59e7e35baf23 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:01.991531 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-98b4cdb5-da5b-4833-b5ce-59e7e35baf23 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:01.992290 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-98b4cdb5-da5b-4833-b5ce-59e7e35baf23 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:01.992724 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-98b4cdb5-da5b-4833-b5ce-59e7e35baf23 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:02.133369 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-98b4cdb5-da5b-4833-b5ce-59e7e35baf23 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:02.141414 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-98b4cdb5-da5b-4833-b5ce-59e7e35baf23 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:02.149182 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-98b4cdb5-da5b-4833-b5ce-59e7e35baf23 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:02.149182 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-98b4cdb5-da5b-4833-b5ce-59e7e35baf23 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.164937 Jul 20 15:37:02.149182 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 284/566] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:01 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:37:02.913699 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-44ac2fb0-fe74-4006-861e-77ec2e63dd07 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:02.914338 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-44ac2fb0-fe74-4006-861e-77ec2e63dd07 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:02.921194 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-44ac2fb0-fe74-4006-861e-77ec2e63dd07 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:02.921658 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-44ac2fb0-fe74-4006-861e-77ec2e63dd07 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:02.922487 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-44ac2fb0-fe74-4006-861e-77ec2e63dd07 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:02.922911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-44ac2fb0-fe74-4006-861e-77ec2e63dd07 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:03.061199 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-44ac2fb0-fe74-4006-861e-77ec2e63dd07 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:03.068889 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-44ac2fb0-fe74-4006-861e-77ec2e63dd07 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1673 microversion: 2.1 time: 0.159187 Jul 20 15:37:03.069464 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 283/567] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:02 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:03.132655 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-52e84a4e-4185-4d47-a8ce-cd525f474fef tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1288966897", "imageRef": "80914b1c-623c-42a8-810e-836b2cce0d3b", "flavorRef": "452", "networks": [{"uuid": "f8cc0700-5535-424a-ac7f-e08c5c1408c4"}]}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:37:03.163291 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-6775741e-4b66-4b6a-b01f-37a9857c30fa tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:03.163897 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-6775741e-4b66-4b6a-b01f-37a9857c30fa tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:03.169701 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6775741e-4b66-4b6a-b01f-37a9857c30fa tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:03.170152 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6775741e-4b66-4b6a-b01f-37a9857c30fa tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:03.170943 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6775741e-4b66-4b6a-b01f-37a9857c30fa tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:03.171453 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6775741e-4b66-4b6a-b01f-37a9857c30fa tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:03.185531 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.network.neutron [None req-52e84a4e-4185-4d47-a8ce-cd525f474fef tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] validate_networks() for [('f8cc0700-5535-424a-ac7f-e08c5c1408c4', None, None, None, None, None)] {{(pid=124712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 15:37:03.399347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-6775741e-4b66-4b6a-b01f-37a9857c30fa tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:03.408339 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-6775741e-4b66-4b6a-b01f-37a9857c30fa tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:03.409856 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-6775741e-4b66-4b6a-b01f-37a9857c30fa tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:03.411042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-6775741e-4b66-4b6a-b01f-37a9857c30fa tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.251571 Jul 20 15:37:03.411597 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 284/568] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:03 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:37:03.678483 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-52e84a4e-4185-4d47-a8ce-cd525f474fef tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Flavor limits 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 15:37:03.678899 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-52e84a4e-4185-4d47-a8ce-cd525f474fef tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Image limits 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 15:37:03.679379 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-52e84a4e-4185-4d47-a8ce-cd525f474fef tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Flavor pref 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 15:37:03.679781 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-52e84a4e-4185-4d47-a8ce-cd525f474fef tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Image pref 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 15:37:03.680183 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-52e84a4e-4185-4d47-a8ce-cd525f474fef tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 15:37:03.689588 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-52e84a4e-4185-4d47-a8ce-cd525f474fef tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:03.690034 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-52e84a4e-4185-4d47-a8ce-cd525f474fef tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:03.690862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-52e84a4e-4185-4d47-a8ce-cd525f474fef tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:03.691300 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-52e84a4e-4185-4d47-a8ce-cd525f474fef tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:03.708328 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-52e84a4e-4185-4d47-a8ce-cd525f474fef tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Getting quotas for project 3e3b499bb69b4b449a2e2515d94094fb. Resources: {'instances', 'ram', 'cores'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:37:03.712488 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-52e84a4e-4185-4d47-a8ce-cd525f474fef tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Getting quotas for user 9ea2abd1398f4fba93b3b7a5beb52ba0 and project 3e3b499bb69b4b449a2e2515d94094fb. Resources: {'instances', 'ram', 'cores'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:37:03.723239 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-52e84a4e-4185-4d47-a8ce-cd525f474fef tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Going to run 1 instances... {{(pid=124712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 15:37:03.725444 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-52e84a4e-4185-4d47-a8ce-cd525f474fef tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80914b1c-623c-42a8-810e-836b2cce0d3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 15:37:03.877157 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-52e84a4e-4185-4d47-a8ce-cd525f474fef tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748166 Jul 20 15:37:03.877757 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 285/569] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Jul 20 15:37:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 15:37:03.888817 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-40cf6909-d808-4e78-b97a-c89113129d43 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:03.889475 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-40cf6909-d808-4e78-b97a-c89113129d43 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:03.943865 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-40cf6909-d808-4e78-b97a-c89113129d43 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:03.950979 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-40cf6909-d808-4e78-b97a-c89113129d43 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823" status: 200 len: 1219 microversion: 2.1 time: 0.066876 Jul 20 15:37:03.951881 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 285/570] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:03 2022] GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:04.086249 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b50bcb3a-298d-452d-9f8b-0fa4c412bc99 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:04.087023 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b50bcb3a-298d-452d-9f8b-0fa4c412bc99 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:04.101322 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b50bcb3a-298d-452d-9f8b-0fa4c412bc99 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:04.101803 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b50bcb3a-298d-452d-9f8b-0fa4c412bc99 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:04.103138 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b50bcb3a-298d-452d-9f8b-0fa4c412bc99 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:04.103395 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b50bcb3a-298d-452d-9f8b-0fa4c412bc99 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:04.296529 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b50bcb3a-298d-452d-9f8b-0fa4c412bc99 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:04.304165 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b50bcb3a-298d-452d-9f8b-0fa4c412bc99 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1673 microversion: 2.1 time: 0.222372 Jul 20 15:37:04.304734 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 286/571] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:04 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1673 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:04.430683 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-24073f7f-feef-4cf5-b60f-a22550574802 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:04.431294 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-24073f7f-feef-4cf5-b60f-a22550574802 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:04.437713 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-24073f7f-feef-4cf5-b60f-a22550574802 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:04.438152 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-24073f7f-feef-4cf5-b60f-a22550574802 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:04.448809 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-24073f7f-feef-4cf5-b60f-a22550574802 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:04.448809 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-24073f7f-feef-4cf5-b60f-a22550574802 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:04.608377 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-24073f7f-feef-4cf5-b60f-a22550574802 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:04.616727 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-24073f7f-feef-4cf5-b60f-a22550574802 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:04.618411 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-24073f7f-feef-4cf5-b60f-a22550574802 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:04.619585 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-24073f7f-feef-4cf5-b60f-a22550574802 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1722 microversion: 2.20 time: 0.193240 Jul 20 15:37:04.620313 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 286/572] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:04 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:37:04.969918 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-8e62b6a0-c1da-44ae-8d97-09139f206c9c tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:04.970572 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-8e62b6a0-c1da-44ae-8d97-09139f206c9c tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:04.972465 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:05.039046 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-8e62b6a0-c1da-44ae-8d97-09139f206c9c tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:05.046361 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-8e62b6a0-c1da-44ae-8d97-09139f206c9c tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823" status: 200 len: 1219 microversion: 2.1 time: 0.080732 Jul 20 15:37:05.047180 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 287/573] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:04 2022] GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:05.322541 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-f66895d8-62c1-4905-925c-c5155da46eba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:05.323170 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-f66895d8-62c1-4905-925c-c5155da46eba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:05.333799 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f66895d8-62c1-4905-925c-c5155da46eba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:05.334867 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f66895d8-62c1-4905-925c-c5155da46eba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:05.335942 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f66895d8-62c1-4905-925c-c5155da46eba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:05.336667 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f66895d8-62c1-4905-925c-c5155da46eba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:05.410462 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-f66895d8-62c1-4905-925c-c5155da46eba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:05.421624 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-f66895d8-62c1-4905-925c-c5155da46eba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1605 microversion: 2.1 time: 0.102632 Jul 20 15:37:05.422032 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 287/574] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:05 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1605 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:05.640433 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-87634b2e-7aec-44ea-9044-8a5dea6802a3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:05.640433 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-87634b2e-7aec-44ea-9044-8a5dea6802a3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:05.652155 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-87634b2e-7aec-44ea-9044-8a5dea6802a3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:05.652806 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-87634b2e-7aec-44ea-9044-8a5dea6802a3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:05.653793 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-87634b2e-7aec-44ea-9044-8a5dea6802a3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:05.654422 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-87634b2e-7aec-44ea-9044-8a5dea6802a3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:05.708630 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-63a6e336-06de-48a0-8b54-38f91ca42147 req-12c2062a-d28a-4b44-8388-727df2e7418d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7693c05d-ad3d-40fb-8c50-56e655ca708a", "name": "network-vif-deleted", "tag": "7c61a150-9d0c-4c43-949a-82e85b926581"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:37:05.718805 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-63a6e336-06de-48a0-8b54-38f91ca42147 req-12c2062a-d28a-4b44-8388-727df2e7418d service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:05.719641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-63a6e336-06de-48a0-8b54-38f91ca42147 req-12c2062a-d28a-4b44-8388-727df2e7418d service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:05.734283 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-63a6e336-06de-48a0-8b54-38f91ca42147 req-12c2062a-d28a-4b44-8388-727df2e7418d service nova] Creating event network-vif-deleted:7c61a150-9d0c-4c43-949a-82e85b926581 for instance 7693c05d-ad3d-40fb-8c50-56e655ca708a on hv-cinder-81914 Jul 20 15:37:05.740360 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-63a6e336-06de-48a0-8b54-38f91ca42147 req-12c2062a-d28a-4b44-8388-727df2e7418d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035285 Jul 20 15:37:05.742409 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 288/575] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:37:05.757168 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-87634b2e-7aec-44ea-9044-8a5dea6802a3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:05.778173 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-87634b2e-7aec-44ea-9044-8a5dea6802a3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:05.781836 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-87634b2e-7aec-44ea-9044-8a5dea6802a3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:05.785095 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-87634b2e-7aec-44ea-9044-8a5dea6802a3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1655 microversion: 2.20 time: 0.150491 Jul 20 15:37:05.799104 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 288/576] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:05 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1655 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:37:06.065191 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e780bcf7-fa40-4e00-a659-bd8b3812932b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:06.065935 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e780bcf7-fa40-4e00-a659-bd8b3812932b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:06.073037 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e780bcf7-fa40-4e00-a659-bd8b3812932b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:06.073571 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e780bcf7-fa40-4e00-a659-bd8b3812932b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:06.074431 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e780bcf7-fa40-4e00-a659-bd8b3812932b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:06.074876 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e780bcf7-fa40-4e00-a659-bd8b3812932b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:06.165723 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e780bcf7-fa40-4e00-a659-bd8b3812932b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:06.167747 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e780bcf7-fa40-4e00-a659-bd8b3812932b tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823" status: 200 len: 1271 microversion: 2.1 time: 0.107903 Jul 20 15:37:06.168741 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 289/577] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:06 2022] GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823 => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:06.440327 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-17600501-a4d1-4c04-9aa1-334ce4abead3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:06.440859 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-17600501-a4d1-4c04-9aa1-334ce4abead3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:06.448463 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-17600501-a4d1-4c04-9aa1-334ce4abead3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:06.449157 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-17600501-a4d1-4c04-9aa1-334ce4abead3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:06.450504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-17600501-a4d1-4c04-9aa1-334ce4abead3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:06.451072 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-17600501-a4d1-4c04-9aa1-334ce4abead3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:06.493628 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-17600501-a4d1-4c04-9aa1-334ce4abead3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:06.494384 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-17600501-a4d1-4c04-9aa1-334ce4abead3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:06.494828 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.objects.instance [None req-17600501-a4d1-4c04-9aa1-334ce4abead3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lazy-loading 'fault' on Instance uuid 7693c05d-ad3d-40fb-8c50-56e655ca708a {{(pid=124712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:37:06.577140 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-17600501-a4d1-4c04-9aa1-334ce4abead3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:06.593557 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-17600501-a4d1-4c04-9aa1-334ce4abead3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 200 len: 1327 microversion: 2.1 time: 0.151636 Jul 20 15:37:06.593994 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 289/578] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:06 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 1327 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:06.805711 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-81040737-c167-40c0-ac75-a6ca199abfa4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:06.806472 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-81040737-c167-40c0-ac75-a6ca199abfa4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:06.835712 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-81040737-c167-40c0-ac75-a6ca199abfa4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:06.843387 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-81040737-c167-40c0-ac75-a6ca199abfa4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:06.844967 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-81040737-c167-40c0-ac75-a6ca199abfa4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:06.846013 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-81040737-c167-40c0-ac75-a6ca199abfa4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:06.913539 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-81040737-c167-40c0-ac75-a6ca199abfa4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:06.914510 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-81040737-c167-40c0-ac75-a6ca199abfa4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:06.915372 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.objects.instance [None req-81040737-c167-40c0-ac75-a6ca199abfa4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lazy-loading 'fault' on Instance uuid f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 {{(pid=124711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:37:06.974376 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-81040737-c167-40c0-ac75-a6ca199abfa4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:06.984185 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-81040737-c167-40c0-ac75-a6ca199abfa4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:06.985740 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-81040737-c167-40c0-ac75-a6ca199abfa4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:06.999329 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-81040737-c167-40c0-ac75-a6ca199abfa4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 200 len: 1371 microversion: 2.20 time: 0.185536 Jul 20 15:37:06.999329 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 290/579] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:06 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:37:07.186140 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e7c81445-4a5d-4ddf-988f-f4539c1c44a8 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:07.192607 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e7c81445-4a5d-4ddf-988f-f4539c1c44a8 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:07.212808 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e7c81445-4a5d-4ddf-988f-f4539c1c44a8 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:07.218550 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e7c81445-4a5d-4ddf-988f-f4539c1c44a8 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:07.219893 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e7c81445-4a5d-4ddf-988f-f4539c1c44a8 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:07.220618 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e7c81445-4a5d-4ddf-988f-f4539c1c44a8 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:07.337038 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-e7c81445-4a5d-4ddf-988f-f4539c1c44a8 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:07.350159 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-e7c81445-4a5d-4ddf-988f-f4539c1c44a8 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823" status: 200 len: 1289 microversion: 2.1 time: 0.168291 Jul 20 15:37:07.361790 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 290/580] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:07 2022] GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823 => generated 1289 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:07.611810 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5b7b4554-3a0e-4116-8169-351c877f9d57 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:07.612638 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5b7b4554-3a0e-4116-8169-351c877f9d57 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:07.625058 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5b7b4554-3a0e-4116-8169-351c877f9d57 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:07.625522 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5b7b4554-3a0e-4116-8169-351c877f9d57 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:07.626335 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5b7b4554-3a0e-4116-8169-351c877f9d57 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:07.626846 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5b7b4554-3a0e-4116-8169-351c877f9d57 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:07.645956 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-5b7b4554-3a0e-4116-8169-351c877f9d57 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] HTTP exception thrown: Instance 7693c05d-ad3d-40fb-8c50-56e655ca708a could not be found. Jul 20 15:37:07.647644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5b7b4554-3a0e-4116-8169-351c877f9d57 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Request method failure captured: Jul 20 15:37:07.647644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a HTTP/1.1 Jul 20 15:37:07.647644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:37:07.647644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:37:07.647644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:37:07.647644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:37:07.647644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:37:07.647644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:37:07.647644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:37:07.647644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:37:07.647644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2B_nFuXYvlPrzYrTX8Q0s9aWu_-1pGR0bg32z749fIJLCJUTkGlaDTx5FkW0yG1uQes0XdtWNU-TVzz-t5ln2jKlua2Ul_rKyQ5Dy4IaYJXUbdlUz9W4TsuDc_u_W31MwuadvDauT2Fxiat4gefQ485mZJrDdkGpr34G9CIk5uIm500 Jul 20 15:37:07.647644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:37:07.647644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:37:07.647644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:37:07.647644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:37:07.647644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:37:07.647644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:37:07.647644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: aa49d7002cf441348cf3166e64b1bc87 Jul 20 15:37:07.647644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-AttachVolumeTestJSON-1914876992 Jul 20 15:37:07.647644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:37:07.647644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:37:07.651365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa49d7002cf441348cf3166e64b1bc87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aa49d7002cf441348cf3166e64b1bc87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aa49d7002cf441348cf3166e64b1bc87", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa49d7002cf441348cf3166e64b1bc87"}]}] Jul 20 15:37:07.651365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-AttachVolumeTestJSON-1914876992 Jul 20 15:37:07.651365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: aa49d7002cf441348cf3166e64b1bc87 Jul 20 15:37:07.651365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1914876992 Jul 20 15:37:07.651365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-AttachVolumeTestJSON-1914876992-project Jul 20 15:37:07.651365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:37:07.651365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:37:07.651365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: 8e75c180bae74be0b2ccad079f92d32b Jul 20 15:37:07.651365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-AttachVolumeTestJSON-1914876992-project Jul 20 15:37:07.651365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: > Jul 20 15:37:07.651365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Instance 7693c05d-ad3d-40fb-8c50-56e655ca708a could not be found. Jul 20 15:37:07.651365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': '7693c05d-ad3d-40fb-8c50-56e655ca708a'} Jul 20 15:37:07.653023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:37:07.653023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:37:07.653023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:37:07.653023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:37:07.653023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:37:07.653023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:37:07.653023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:37:07.653023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:37:07.653023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:37:07.653023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:37:07.653023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7693c05d-ad3d-40fb-8c50-56e655ca708a could not be found. Jul 20 15:37:07.653023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:37:07.653023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:37:07.653023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:37:07.653023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:37:07.653023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:37:07.653023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:37:07.653023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:37:07.653023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:37:07.653023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:37:07.655424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:37:07.655424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:37:07.655424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:37:07.655424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:37:07.655424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:37:07.655424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:37:07.655424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:37:07.655424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7693c05d-ad3d-40fb-8c50-56e655ca708a could not be found. Jul 20 15:37:07.655424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:37:07.655424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:37:07.655424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:37:07.655424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:37:07.655424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:37:07.655424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:37:07.655424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:37:07.655424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:37:07.655424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7693c05d-ad3d-40fb-8c50-56e655ca708a could not be found. Jul 20 15:37:07.655424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:37:07.657478 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5b7b4554-3a0e-4116-8169-351c877f9d57 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Returning 404 to user: Instance 7693c05d-ad3d-40fb-8c50-56e655ca708a could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:37:07.657478 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5b7b4554-3a0e-4116-8169-351c877f9d57 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 404 len: 111 microversion: 2.1 time: 0.041578 Jul 20 15:37:07.657478 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 291/581] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:07 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:37:07.664411 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-dcb6b9c5-efcd-4f67-816a-db2301258c37 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '.version_select at 0x7efd90a368b0>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:07.671391 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dcb6b9c5-efcd-4f67-816a-db2301258c37 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [c0a9aef5-ce5e-42af-b9ad-5f2289e21e52] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 15:37:07.800285 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-6374c3c8-8207-4736-a964-c542f19b4ad2 req-114f3a1b-bf7f-4d20-a72c-7604b974eeac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4cd0f35-70ba-409d-b217-32d5a9ab6cd6", "name": "network-vif-deleted", "tag": "59e14bde-8d7e-43e1-8cdf-acd276b65784"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:37:07.818033 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-6374c3c8-8207-4736-a964-c542f19b4ad2 req-114f3a1b-bf7f-4d20-a72c-7604b974eeac service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:07.819670 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-6374c3c8-8207-4736-a964-c542f19b4ad2 req-114f3a1b-bf7f-4d20-a72c-7604b974eeac service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:07.848770 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-6374c3c8-8207-4736-a964-c542f19b4ad2 req-114f3a1b-bf7f-4d20-a72c-7604b974eeac service nova] Creating event network-vif-deleted:59e14bde-8d7e-43e1-8cdf-acd276b65784 for instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 on hv-cinder-81914 Jul 20 15:37:07.854448 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-6374c3c8-8207-4736-a964-c542f19b4ad2 req-114f3a1b-bf7f-4d20-a72c-7604b974eeac service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088312 Jul 20 15:37:07.855391 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 292/582] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:37:08.017801 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-7de28cba-ba2d-4ccb-ac36-13e5467e38f4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:08.018741 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-7de28cba-ba2d-4ccb-ac36-13e5467e38f4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:08.025569 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7de28cba-ba2d-4ccb-ac36-13e5467e38f4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:08.026025 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7de28cba-ba2d-4ccb-ac36-13e5467e38f4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:08.026905 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7de28cba-ba2d-4ccb-ac36-13e5467e38f4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:08.027350 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7de28cba-ba2d-4ccb-ac36-13e5467e38f4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:08.043243 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-7de28cba-ba2d-4ccb-ac36-13e5467e38f4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] HTTP exception thrown: Instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 could not be found. Jul 20 15:37:08.045586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-7de28cba-ba2d-4ccb-ac36-13e5467e38f4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Request method failure captured: Jul 20 15:37:08.045586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 HTTP/1.1 Jul 20 15:37:08.045586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:37:08.045586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:37:08.045586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:37:08.045586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:37:08.045586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:37:08.045586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:37:08.045586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:37:08.045586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:37:08.045586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2B_tham71lkFjLX120R-m9c9Xg8I1u5NXFR7XRX0lDoiCHu0puQ5EXiCqeCoAfnd0pr4d1p1A4Wtg_FhMOCr-bSRLuze-82So8qSdjlLGkbP_KwkWIEPVJOiXkzFjGjoo2PVspwIuYeREmCvEU13xwSx0aVwgKeL-6IxYKwVbH2jBGU Jul 20 15:37:08.045586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:37:08.045586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:37:08.045586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:37:08.045586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:37:08.045586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 15:37:08.045586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:37:08.045586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:37:08.045586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: 4446d4a6f4e64ccb8bfd5b3fe6f2127a Jul 20 15:37:08.045586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-406309550 Jul 20 15:37:08.045586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:37:08.045586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:37:08.050960 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4446d4a6f4e64ccb8bfd5b3fe6f2127a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4446d4a6f4e64ccb8bfd5b3fe6f2127a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4446d4a6f4e64ccb8bfd5b3fe6f2127a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4446d4a6f4e64ccb8bfd5b3fe6f2127a"}]}] Jul 20 15:37:08.050960 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-AttachVolumeShelveTestJSON-406309550 Jul 20 15:37:08.050960 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: 4446d4a6f4e64ccb8bfd5b3fe6f2127a Jul 20 15:37:08.050960 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-406309550 Jul 20 15:37:08.050960 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-AttachVolumeShelveTestJSON-406309550-project Jul 20 15:37:08.050960 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:37:08.050960 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:37:08.050960 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: 6498ef5c517c4fa4abed90e430936ded Jul 20 15:37:08.050960 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-AttachVolumeShelveTestJSON-406309550-project Jul 20 15:37:08.050960 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: > Jul 20 15:37:08.050960 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 could not be found. Jul 20 15:37:08.050960 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': 'f4cd0f35-70ba-409d-b217-32d5a9ab6cd6'} Jul 20 15:37:08.052325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:37:08.052325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:37:08.052325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:37:08.052325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:37:08.052325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:37:08.052325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:37:08.052325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:37:08.052325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:37:08.052325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:37:08.052325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:37:08.052325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 could not be found. Jul 20 15:37:08.052325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:37:08.052325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:37:08.052325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:37:08.052325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:37:08.052325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:37:08.052325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:37:08.052325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:37:08.052325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:37:08.052325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:37:08.059588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:37:08.059588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:37:08.059588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:37:08.059588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:37:08.059588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:37:08.059588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:37:08.059588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:37:08.059588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 could not be found. Jul 20 15:37:08.059588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:37:08.059588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:37:08.059588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:37:08.059588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:37:08.059588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:37:08.059588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:37:08.059588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:37:08.059588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:37:08.059588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 could not be found. Jul 20 15:37:08.059588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:37:08.064236 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-7de28cba-ba2d-4ccb-ac36-13e5467e38f4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Returning 404 to user: Instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:37:08.064236 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-7de28cba-ba2d-4ccb-ac36-13e5467e38f4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 404 len: 111 microversion: 2.20 time: 0.033869 Jul 20 15:37:08.064236 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 293/583] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:08 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 15:37:08.064236 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-47bd8139-cbed-468b-80f2-a79499d447ba tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '.version_select at 0x7efd90ac0dc0>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:08.157277 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-47bd8139-cbed-468b-80f2-a79499d447ba tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1394049907" status: 204 len: 0 microversion: 2.20 time: 0.104363 Jul 20 15:37:08.158017 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 294/584] 10.222.0.78 () {60 vars in 1261 bytes} [Wed Jul 20 15:37:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1394049907 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 15:37:08.372777 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-b9c44b6b-cfe8-4fc2-8653-e6690afd4233 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:08.374103 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-b9c44b6b-cfe8-4fc2-8653-e6690afd4233 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:08.383134 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b9c44b6b-cfe8-4fc2-8653-e6690afd4233 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:08.383856 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b9c44b6b-cfe8-4fc2-8653-e6690afd4233 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:08.384809 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b9c44b6b-cfe8-4fc2-8653-e6690afd4233 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:08.385385 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b9c44b6b-cfe8-4fc2-8653-e6690afd4233 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:08.601220 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-b9c44b6b-cfe8-4fc2-8653-e6690afd4233 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:08.611493 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-b9c44b6b-cfe8-4fc2-8653-e6690afd4233 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823" status: 200 len: 1319 microversion: 2.1 time: 0.245666 Jul 20 15:37:08.613170 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 295/585] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:08 2022] GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:37:08.682139 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO oslo.messaging._drivers.impl_rabbit [None req-dcb6b9c5-efcd-4f67-816a-db2301258c37 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [c0a9aef5-ce5e-42af-b9ad-5f2289e21e52] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 35272. Jul 20 15:37:08.768874 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-dcb6b9c5-efcd-4f67-816a-db2301258c37 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1033743579" status: 202 len: 0 microversion: 2.1 time: 1.112618 Jul 20 15:37:08.769875 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 291/586] 10.222.0.78 () {58 vars in 1220 bytes} [Wed Jul 20 15:37:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1033743579 => generated 0 bytes in 1116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:37:09.632388 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-307ca4f0-3980-4de6-bbb1-d52bb3913b50 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:09.633051 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-307ca4f0-3980-4de6-bbb1-d52bb3913b50 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:09.640310 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-bb24a5ac-5feb-4ef4-8937-c04e46f8c498 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Action: 'create', calling method: .version_select at 0x7efd9097ee50>, body: {"keypair": {"name": "tempest-keypair-317605155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2hwAQG5K1VRNPsrXFzUTqWXMT1nwkkz4qZ5mOrwJ9r6qlaq+bGEN5U3o/5/oflVEira/HH79RBaBIbdT3XzVoJyaYhTehIa1Ft687vfDo9NiLd3wqd7AYtgXy58Vyyjw=="}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:37:09.653087 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-307ca4f0-3980-4de6-bbb1-d52bb3913b50 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:09.653926 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-307ca4f0-3980-4de6-bbb1-d52bb3913b50 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:09.655044 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-307ca4f0-3980-4de6-bbb1-d52bb3913b50 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:09.655598 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-307ca4f0-3980-4de6-bbb1-d52bb3913b50 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:09.665193 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-bb24a5ac-5feb-4ef4-8937-c04e46f8c498 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Getting quotas for project 4446d4a6f4e64ccb8bfd5b3fe6f2127a. Resources: {'key_pairs'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:37:09.669507 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-bb24a5ac-5feb-4ef4-8937-c04e46f8c498 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Getting quotas for user 6498ef5c517c4fa4abed90e430936ded and project 4446d4a6f4e64ccb8bfd5b3fe6f2127a. Resources: {'key_pairs'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:37:09.767834 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-bb24a5ac-5feb-4ef4-8937-c04e46f8c498 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.132343 Jul 20 15:37:09.769197 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 292/587] 10.222.0.78 () {62 vars in 1199 bytes} [Wed Jul 20 15:37:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 15:37:09.837630 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-307ca4f0-3980-4de6-bbb1-d52bb3913b50 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:09.846123 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-307ca4f0-3980-4de6-bbb1-d52bb3913b50 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823" status: 200 len: 1319 microversion: 2.1 time: 0.220136 Jul 20 15:37:09.846990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 296/588] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:09 2022] GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:09.873542 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-387e0904-ea65-466a-a911-8eccc0304235 req-b5338a9c-9b3c-4dec-91ca-45fa4344d9e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6d19002-eab6-4af7-b0bc-65bf247b3823", "tag": "4d6584c0-9719-4f3c-9c31-bd0bd3f2bb1a"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:37:09.882677 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-387e0904-ea65-466a-a911-8eccc0304235 req-b5338a9c-9b3c-4dec-91ca-45fa4344d9e8 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:09.883125 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-387e0904-ea65-466a-a911-8eccc0304235 req-b5338a9c-9b3c-4dec-91ca-45fa4344d9e8 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:09.894890 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-387e0904-ea65-466a-a911-8eccc0304235 req-b5338a9c-9b3c-4dec-91ca-45fa4344d9e8 service nova] Creating event network-changed:4d6584c0-9719-4f3c-9c31-bd0bd3f2bb1a for instance c6d19002-eab6-4af7-b0bc-65bf247b3823 on hv-cinder-81914 Jul 20 15:37:09.900873 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-387e0904-ea65-466a-a911-8eccc0304235 req-b5338a9c-9b3c-4dec-91ca-45fa4344d9e8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031826 Jul 20 15:37:09.909296 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 293/589] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:37:10.125074 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d13f1c5b-3a73-4eed-8609-f691f006e142 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Action: 'create', calling method: .version_select at 0x7efd90a075e0>, body: {"keypair": {"name": "tempest-keypair-165168349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6/Z7Kss0keTY5iZbn8qOxnXFLOmyCjQgb+slm9W4L5YjUx6LqT7VUlAOYz6oQ8yTEhBshiW476qHj62/cxvTflACRwb4K7NeO3LZPvyVgZ+miggCj35iEbENh5PEks6g=="}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:37:10.139653 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-d13f1c5b-3a73-4eed-8609-f691f006e142 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Getting quotas for project aa49d7002cf441348cf3166e64b1bc87. Resources: {'key_pairs'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:37:10.144414 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-d13f1c5b-3a73-4eed-8609-f691f006e142 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Getting quotas for user 8e75c180bae74be0b2ccad079f92d32b and project aa49d7002cf441348cf3166e64b1bc87. Resources: {'key_pairs'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:37:10.241874 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d13f1c5b-3a73-4eed-8609-f691f006e142 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.120265 Jul 20 15:37:10.241874 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 297/590] 10.222.0.78 () {60 vars in 1158 bytes} [Wed Jul 20 15:37:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:37:10.864813 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-89dd95aa-221b-4dd0-9c81-5a3c50b8524e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:10.865763 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-89dd95aa-221b-4dd0-9c81-5a3c50b8524e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:10.875905 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-89dd95aa-221b-4dd0-9c81-5a3c50b8524e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:10.876360 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-89dd95aa-221b-4dd0-9c81-5a3c50b8524e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:10.877143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-89dd95aa-221b-4dd0-9c81-5a3c50b8524e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:10.877589 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-89dd95aa-221b-4dd0-9c81-5a3c50b8524e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:11.063784 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-89dd95aa-221b-4dd0-9c81-5a3c50b8524e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:11.071687 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-89dd95aa-221b-4dd0-9c81-5a3c50b8524e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823" status: 200 len: 1319 microversion: 2.1 time: 0.212622 Jul 20 15:37:11.072280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 294/591] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:10 2022] GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:12.091572 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-40c90493-c2e4-44d8-a807-a7240bdeff65 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:12.100657 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-40c90493-c2e4-44d8-a807-a7240bdeff65 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:12.101740 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-40c90493-c2e4-44d8-a807-a7240bdeff65 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:12.101966 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-40c90493-c2e4-44d8-a807-a7240bdeff65 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:12.102911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-40c90493-c2e4-44d8-a807-a7240bdeff65 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:12.103360 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-40c90493-c2e4-44d8-a807-a7240bdeff65 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:12.321168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-40c90493-c2e4-44d8-a807-a7240bdeff65 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:12.333458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-40c90493-c2e4-44d8-a807-a7240bdeff65 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823" status: 200 len: 1319 microversion: 2.1 time: 0.246582 Jul 20 15:37:12.334979 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 298/592] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:12 2022] GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:13.089929 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-9f42efcd-2245-4878-8ef5-3e6af9398eb3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-887159636", "imageRef": "80914b1c-623c-42a8-810e-836b2cce0d3b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f5eb24be-2bbb-47ab-b680-70a114f8f10e"}], "security_groups": [{"name": "tempest-securitygroup--506882637"}], "key_name": "tempest-keypair-317605155", "user_data": "}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:37:13.242422 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.network.neutron [None req-9f42efcd-2245-4878-8ef5-3e6af9398eb3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] validate_networks() for [('f5eb24be-2bbb-47ab-b680-70a114f8f10e', None, None, None, None, None)] {{(pid=124712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 15:37:13.355930 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-3f0922d1-2009-4478-8f4b-b93e5586302e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:13.356730 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-3f0922d1-2009-4478-8f4b-b93e5586302e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:13.363655 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3f0922d1-2009-4478-8f4b-b93e5586302e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:13.364128 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3f0922d1-2009-4478-8f4b-b93e5586302e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:13.365088 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3f0922d1-2009-4478-8f4b-b93e5586302e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:13.365529 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3f0922d1-2009-4478-8f4b-b93e5586302e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:13.623296 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-3f0922d1-2009-4478-8f4b-b93e5586302e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:13.631114 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-3f0922d1-2009-4478-8f4b-b93e5586302e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823" status: 200 len: 1319 microversion: 2.1 time: 0.279727 Jul 20 15:37:13.631903 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 299/593] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:13 2022] GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:13.698635 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=2 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:13.913793 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-9f42efcd-2245-4878-8ef5-3e6af9398eb3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Flavor limits 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 15:37:13.914327 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-9f42efcd-2245-4878-8ef5-3e6af9398eb3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Image limits 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 15:37:13.914876 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-9f42efcd-2245-4878-8ef5-3e6af9398eb3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Flavor pref 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 15:37:13.915371 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-9f42efcd-2245-4878-8ef5-3e6af9398eb3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Image pref 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 15:37:13.915981 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-9f42efcd-2245-4878-8ef5-3e6af9398eb3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 15:37:13.925901 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9f42efcd-2245-4878-8ef5-3e6af9398eb3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:13.926594 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9f42efcd-2245-4878-8ef5-3e6af9398eb3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:13.930772 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9f42efcd-2245-4878-8ef5-3e6af9398eb3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:13.930772 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9f42efcd-2245-4878-8ef5-3e6af9398eb3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:13.946082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-9f42efcd-2245-4878-8ef5-3e6af9398eb3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Getting quotas for project 4446d4a6f4e64ccb8bfd5b3fe6f2127a. Resources: {'instances', 'ram', 'cores'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:37:13.950349 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-9f42efcd-2245-4878-8ef5-3e6af9398eb3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Getting quotas for user 6498ef5c517c4fa4abed90e430936ded and project 4446d4a6f4e64ccb8bfd5b3fe6f2127a. Resources: {'instances', 'ram', 'cores'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:37:13.961876 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-9f42efcd-2245-4878-8ef5-3e6af9398eb3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Going to run 1 instances... {{(pid=124712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 15:37:13.964297 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-9f42efcd-2245-4878-8ef5-3e6af9398eb3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80914b1c-623c-42a8-810e-836b2cce0d3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 15:37:14.109814 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c0456d22-8a84-4e2d-a441-55d123d2165a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-351035858", "imageRef": "80914b1c-623c-42a8-810e-836b2cce0d3b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fa5e056d-5a56-4462-a470-30c02f844e62"}], "security_groups": [{"name": "tempest-securitygroup--1062302096"}], "key_name": "tempest-keypair-165168349", "user_data": "}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:37:14.161766 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-9f42efcd-2245-4878-8ef5-3e6af9398eb3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.076139 Jul 20 15:37:14.162442 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 295/594] 10.222.0.78 () {62 vars in 1187 bytes} [Wed Jul 20 15:37:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 15:37:14.181950 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e928fe96-4a65-4925-a10a-be289b6628f9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:14.182660 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e928fe96-4a65-4925-a10a-be289b6628f9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:14.251191 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-e928fe96-4a65-4925-a10a-be289b6628f9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:14.252706 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.network.neutron [None req-c0456d22-8a84-4e2d-a441-55d123d2165a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] validate_networks() for [('fa5e056d-5a56-4462-a470-30c02f844e62', None, None, None, None, None)] {{(pid=124711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 15:37:14.259225 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-e928fe96-4a65-4925-a10a-be289b6628f9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:14.260998 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-e928fe96-4a65-4925-a10a-be289b6628f9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:14.263399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-e928fe96-4a65-4925-a10a-be289b6628f9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1280 microversion: 2.20 time: 0.093523 Jul 20 15:37:14.263577 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 296/595] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:14 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1280 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:37:14.655381 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-afffd0de-ec8e-4635-9e2c-12b97ebcc7b9 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:14.655381 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-afffd0de-ec8e-4635-9e2c-12b97ebcc7b9 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:14.658089 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-afffd0de-ec8e-4635-9e2c-12b97ebcc7b9 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:14.658580 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-afffd0de-ec8e-4635-9e2c-12b97ebcc7b9 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:14.659348 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-afffd0de-ec8e-4635-9e2c-12b97ebcc7b9 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:14.659781 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-afffd0de-ec8e-4635-9e2c-12b97ebcc7b9 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:14.733781 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-c0456d22-8a84-4e2d-a441-55d123d2165a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Flavor limits 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 15:37:14.734249 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-c0456d22-8a84-4e2d-a441-55d123d2165a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Image limits 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 15:37:14.734750 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-c0456d22-8a84-4e2d-a441-55d123d2165a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Flavor pref 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 15:37:14.752649 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-c0456d22-8a84-4e2d-a441-55d123d2165a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Image pref 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 15:37:14.752649 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-c0456d22-8a84-4e2d-a441-55d123d2165a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 15:37:14.752649 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c0456d22-8a84-4e2d-a441-55d123d2165a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:14.752649 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c0456d22-8a84-4e2d-a441-55d123d2165a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:14.753193 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c0456d22-8a84-4e2d-a441-55d123d2165a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:14.753193 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c0456d22-8a84-4e2d-a441-55d123d2165a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:14.763541 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-c0456d22-8a84-4e2d-a441-55d123d2165a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Getting quotas for project aa49d7002cf441348cf3166e64b1bc87. Resources: {'instances', 'ram', 'cores'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:37:14.767463 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-c0456d22-8a84-4e2d-a441-55d123d2165a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Getting quotas for user 8e75c180bae74be0b2ccad079f92d32b and project aa49d7002cf441348cf3166e64b1bc87. Resources: {'instances', 'ram', 'cores'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:37:14.783190 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c0456d22-8a84-4e2d-a441-55d123d2165a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Going to run 1 instances... {{(pid=124711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 15:37:14.792655 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c0456d22-8a84-4e2d-a441-55d123d2165a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80914b1c-623c-42a8-810e-836b2cce0d3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 15:37:14.813394 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-afffd0de-ec8e-4635-9e2c-12b97ebcc7b9 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:14.822344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-afffd0de-ec8e-4635-9e2c-12b97ebcc7b9 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823" status: 200 len: 1319 microversion: 2.1 time: 0.176047 Jul 20 15:37:14.832958 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 297/596] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:14 2022] GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:14.964420 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c0456d22-8a84-4e2d-a441-55d123d2165a tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.859487 Jul 20 15:37:14.965214 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 300/597] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Jul 20 15:37:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 15:37:14.975323 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-93442967-2059-47ac-b562-62f115664d8e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:14.976107 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-93442967-2059-47ac-b562-62f115664d8e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:15.037777 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-94b50a3a-eb26-43db-8f1c-ae3686490644 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:15.038964 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-94b50a3a-eb26-43db-8f1c-ae3686490644 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:15.047327 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-93442967-2059-47ac-b562-62f115664d8e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:15.050142 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-94b50a3a-eb26-43db-8f1c-ae3686490644 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:15.054960 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-94b50a3a-eb26-43db-8f1c-ae3686490644 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:15.054960 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-94b50a3a-eb26-43db-8f1c-ae3686490644 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:15.054960 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-94b50a3a-eb26-43db-8f1c-ae3686490644 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:15.056520 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-93442967-2059-47ac-b562-62f115664d8e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1236 microversion: 2.1 time: 0.085111 Jul 20 15:37:15.069012 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 298/598] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:14 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1236 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:15.149943 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.objects.instance [None req-94b50a3a-eb26-43db-8f1c-ae3686490644 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lazy-loading 'services' on Instance uuid 91beb453-6320-472a-951c-3fda16747994 {{(pid=124711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:37:15.280420 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-1966bab3-be69-4777-8eb9-a1e71b62341d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:15.287135 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-1966bab3-be69-4777-8eb9-a1e71b62341d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:15.288791 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1966bab3-be69-4777-8eb9-a1e71b62341d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:15.289245 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1966bab3-be69-4777-8eb9-a1e71b62341d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:15.290014 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1966bab3-be69-4777-8eb9-a1e71b62341d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:15.290493 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1966bab3-be69-4777-8eb9-a1e71b62341d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:15.355408 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-1966bab3-be69-4777-8eb9-a1e71b62341d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:15.364062 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-1966bab3-be69-4777-8eb9-a1e71b62341d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:15.365640 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-1966bab3-be69-4777-8eb9-a1e71b62341d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:15.366763 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-1966bab3-be69-4777-8eb9-a1e71b62341d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1284 microversion: 2.20 time: 0.090268 Jul 20 15:37:15.367335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 299/599] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:15 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:37:15.439073 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-94b50a3a-eb26-43db-8f1c-ae3686490644 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "DELETE /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994/os-volume_attachments/90feec83-6635-4a4c-bcc6-8c3bc1edae76" status: 202 len: 0 microversion: 2.1 time: 0.407859 Jul 20 15:37:15.440204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 301/600] 10.222.0.78 () {58 vars in 1415 bytes} [Wed Jul 20 15:37:15 2022] DELETE /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994/os-volume_attachments/90feec83-6635-4a4c-bcc6-8c3bc1edae76 => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 15:37:15.448996 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-5b39d399-bb11-4811-8cf2-ee20f228d631 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:15.449858 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-5b39d399-bb11-4811-8cf2-ee20f228d631 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:15.458531 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5b39d399-bb11-4811-8cf2-ee20f228d631 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:15.464499 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5b39d399-bb11-4811-8cf2-ee20f228d631 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:15.464499 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5b39d399-bb11-4811-8cf2-ee20f228d631 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:15.464499 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5b39d399-bb11-4811-8cf2-ee20f228d631 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:15.492306 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-5b39d399-bb11-4811-8cf2-ee20f228d631 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047341 Jul 20 15:37:15.492915 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 300/601] 10.222.0.78 () {58 vars in 1301 bytes} [Wed Jul 20 15:37:15 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:37:15.841025 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e9dae0ea-381b-4195-89dd-5884d9c5f53c tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:15.841712 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e9dae0ea-381b-4195-89dd-5884d9c5f53c tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:15.848365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e9dae0ea-381b-4195-89dd-5884d9c5f53c tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:15.848801 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e9dae0ea-381b-4195-89dd-5884d9c5f53c tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:15.852137 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e9dae0ea-381b-4195-89dd-5884d9c5f53c tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:15.852137 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e9dae0ea-381b-4195-89dd-5884d9c5f53c tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:15.993167 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-84ec649d-8f22-4e9e-bb61-d0750ac0f48d req-b0c64466-2b83-4808-8f5e-75180754e803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6d19002-eab6-4af7-b0bc-65bf247b3823", "name": "network-vif-plugged", "status": "completed", "tag": "4d6584c0-9719-4f3c-9c31-bd0bd3f2bb1a"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:37:16.002071 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-84ec649d-8f22-4e9e-bb61-d0750ac0f48d req-b0c64466-2b83-4808-8f5e-75180754e803 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:16.002844 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-84ec649d-8f22-4e9e-bb61-d0750ac0f48d req-b0c64466-2b83-4808-8f5e-75180754e803 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:16.014239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e9dae0ea-381b-4195-89dd-5884d9c5f53c tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:16.015647 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-84ec649d-8f22-4e9e-bb61-d0750ac0f48d req-b0c64466-2b83-4808-8f5e-75180754e803 service nova] Creating event network-vif-plugged:4d6584c0-9719-4f3c-9c31-bd0bd3f2bb1a for instance c6d19002-eab6-4af7-b0bc-65bf247b3823 on hv-cinder-81914 Jul 20 15:37:16.022350 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-84ec649d-8f22-4e9e-bb61-d0750ac0f48d req-b0c64466-2b83-4808-8f5e-75180754e803 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033376 Jul 20 15:37:16.022537 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e9dae0ea-381b-4195-89dd-5884d9c5f53c tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823" status: 200 len: 1319 microversion: 2.1 time: 0.186011 Jul 20 15:37:16.022855 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 302/602] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:15 2022] GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:16.026463 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 301/603] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:37:16.077834 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-f8413d96-1f17-4db1-9d4e-389fb72a7aec tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:16.078476 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-f8413d96-1f17-4db1-9d4e-389fb72a7aec tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:16.085369 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f8413d96-1f17-4db1-9d4e-389fb72a7aec tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:16.085812 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f8413d96-1f17-4db1-9d4e-389fb72a7aec tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:16.086805 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f8413d96-1f17-4db1-9d4e-389fb72a7aec tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:16.087309 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f8413d96-1f17-4db1-9d4e-389fb72a7aec tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:16.139500 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:16.203176 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-f8413d96-1f17-4db1-9d4e-389fb72a7aec tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:16.212824 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-f8413d96-1f17-4db1-9d4e-389fb72a7aec tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1240 microversion: 2.1 time: 0.143050 Jul 20 15:37:16.214585 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 303/604] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:16 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1240 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:16.386588 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-77a56ece-50be-465d-a709-8878ad4de80d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:16.387367 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-77a56ece-50be-465d-a709-8878ad4de80d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:16.394696 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-77a56ece-50be-465d-a709-8878ad4de80d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:16.395157 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-77a56ece-50be-465d-a709-8878ad4de80d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:16.396152 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-77a56ece-50be-465d-a709-8878ad4de80d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:16.396604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-77a56ece-50be-465d-a709-8878ad4de80d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:16.465755 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-77a56ece-50be-465d-a709-8878ad4de80d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:16.473913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-77a56ece-50be-465d-a709-8878ad4de80d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:16.475540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-77a56ece-50be-465d-a709-8878ad4de80d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:16.476658 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-77a56ece-50be-465d-a709-8878ad4de80d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1332 microversion: 2.20 time: 0.095290 Jul 20 15:37:16.477410 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 302/605] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:16 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:37:16.505006 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-efbab087-6a86-4412-a41f-c9d6306f264d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:16.506012 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-efbab087-6a86-4412-a41f-c9d6306f264d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:16.508418 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:16.514168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-efbab087-6a86-4412-a41f-c9d6306f264d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:16.514626 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-efbab087-6a86-4412-a41f-c9d6306f264d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:16.515393 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-efbab087-6a86-4412-a41f-c9d6306f264d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:16.515830 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-efbab087-6a86-4412-a41f-c9d6306f264d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:16.548988 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-efbab087-6a86-4412-a41f-c9d6306f264d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048280 Jul 20 15:37:16.549588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 304/606] 10.222.0.78 () {58 vars in 1301 bytes} [Wed Jul 20 15:37:16 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:37:17.042242 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-101022ba-b929-40cf-ba38-3ecf7d1f330a tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:17.042891 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-101022ba-b929-40cf-ba38-3ecf7d1f330a tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:17.051372 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-101022ba-b929-40cf-ba38-3ecf7d1f330a tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:17.052112 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-101022ba-b929-40cf-ba38-3ecf7d1f330a tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:17.053397 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-101022ba-b929-40cf-ba38-3ecf7d1f330a tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:17.054015 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-101022ba-b929-40cf-ba38-3ecf7d1f330a tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:17.197963 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-101022ba-b929-40cf-ba38-3ecf7d1f330a tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:17.205656 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-101022ba-b929-40cf-ba38-3ecf7d1f330a tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823" status: 200 len: 1319 microversion: 2.1 time: 0.167821 Jul 20 15:37:17.206287 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 303/607] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:17 2022] GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:17.230986 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-0cc63428-d8e9-4ddb-a4df-3394edabf815 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:17.235105 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-0cc63428-d8e9-4ddb-a4df-3394edabf815 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:17.239990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0cc63428-d8e9-4ddb-a4df-3394edabf815 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:17.240431 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0cc63428-d8e9-4ddb-a4df-3394edabf815 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:17.241188 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0cc63428-d8e9-4ddb-a4df-3394edabf815 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:17.241616 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0cc63428-d8e9-4ddb-a4df-3394edabf815 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:17.307041 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-0cc63428-d8e9-4ddb-a4df-3394edabf815 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:17.314780 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-0cc63428-d8e9-4ddb-a4df-3394edabf815 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1232 microversion: 2.1 time: 0.088197 Jul 20 15:37:17.315427 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 305/608] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:17 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1232 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:17.494914 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-17825c09-2e0d-4311-8cf3-5eb71360ed7b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:17.495550 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-17825c09-2e0d-4311-8cf3-5eb71360ed7b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:17.502133 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-17825c09-2e0d-4311-8cf3-5eb71360ed7b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:17.502609 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-17825c09-2e0d-4311-8cf3-5eb71360ed7b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:17.503365 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-17825c09-2e0d-4311-8cf3-5eb71360ed7b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:17.503797 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-17825c09-2e0d-4311-8cf3-5eb71360ed7b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:17.563686 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-1bb49319-37f4-44d6-85b5-630ebc1cea3d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:17.564131 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-1bb49319-37f4-44d6-85b5-630ebc1cea3d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:17.566591 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-17825c09-2e0d-4311-8cf3-5eb71360ed7b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:17.571316 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1bb49319-37f4-44d6-85b5-630ebc1cea3d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:17.571869 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1bb49319-37f4-44d6-85b5-630ebc1cea3d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:17.572726 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1bb49319-37f4-44d6-85b5-630ebc1cea3d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:17.573205 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1bb49319-37f4-44d6-85b5-630ebc1cea3d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:17.576894 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-17825c09-2e0d-4311-8cf3-5eb71360ed7b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:17.578432 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-17825c09-2e0d-4311-8cf3-5eb71360ed7b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:17.579549 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-17825c09-2e0d-4311-8cf3-5eb71360ed7b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1340 microversion: 2.20 time: 0.088532 Jul 20 15:37:17.580106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 304/609] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:17 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1340 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:37:17.604959 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-1bb49319-37f4-44d6-85b5-630ebc1cea3d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046308 Jul 20 15:37:17.605532 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 306/610] 10.222.0.78 () {58 vars in 1301 bytes} [Wed Jul 20 15:37:17 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 15:37:17.684521 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-7a67fe1d-ea98-4c15-9008-166716dcec1e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:17.685037 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-7a67fe1d-ea98-4c15-9008-166716dcec1e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:17.692340 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7a67fe1d-ea98-4c15-9008-166716dcec1e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:17.692801 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7a67fe1d-ea98-4c15-9008-166716dcec1e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:17.693575 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7a67fe1d-ea98-4c15-9008-166716dcec1e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:17.694013 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7a67fe1d-ea98-4c15-9008-166716dcec1e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:17.723761 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-7a67fe1d-ea98-4c15-9008-166716dcec1e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Going to try to terminate instance {{(pid=124712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 15:37:17.764858 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:18.040492 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-7a67fe1d-ea98-4c15-9008-166716dcec1e tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "DELETE /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 204 len: 0 microversion: 2.1 time: 0.359575 Jul 20 15:37:18.041089 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 305/611] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:37:17 2022] DELETE /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 15:37:18.049688 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5627da59-9775-4cbe-a88c-119b496bf893 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:18.050470 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5627da59-9775-4cbe-a88c-119b496bf893 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:18.057393 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5627da59-9775-4cbe-a88c-119b496bf893 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:18.057838 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5627da59-9775-4cbe-a88c-119b496bf893 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:18.058657 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5627da59-9775-4cbe-a88c-119b496bf893 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:18.059091 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5627da59-9775-4cbe-a88c-119b496bf893 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:18.215814 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5627da59-9775-4cbe-a88c-119b496bf893 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:18.222531 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5627da59-9775-4cbe-a88c-119b496bf893 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1685 microversion: 2.1 time: 0.176699 Jul 20 15:37:18.223333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 307/612] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:18 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1685 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:18.226574 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e89deda4-da93-407d-9be0-fa9403fba810 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:18.229251 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e89deda4-da93-407d-9be0-fa9403fba810 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:18.238282 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e89deda4-da93-407d-9be0-fa9403fba810 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:18.242223 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e89deda4-da93-407d-9be0-fa9403fba810 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:18.243514 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e89deda4-da93-407d-9be0-fa9403fba810 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:18.247651 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e89deda4-da93-407d-9be0-fa9403fba810 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:18.332819 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5240401c-dc52-41c0-959e-2be7c781e65b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:18.334984 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5240401c-dc52-41c0-959e-2be7c781e65b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:18.340616 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5240401c-dc52-41c0-959e-2be7c781e65b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:18.342620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5240401c-dc52-41c0-959e-2be7c781e65b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:18.343820 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5240401c-dc52-41c0-959e-2be7c781e65b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:18.344419 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5240401c-dc52-41c0-959e-2be7c781e65b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:18.425460 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5240401c-dc52-41c0-959e-2be7c781e65b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:18.433686 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5240401c-dc52-41c0-959e-2be7c781e65b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1288 microversion: 2.1 time: 0.104963 Jul 20 15:37:18.437534 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 308/613] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:18 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1288 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:18.448183 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-e89deda4-da93-407d-9be0-fa9403fba810 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:18.455960 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-e89deda4-da93-407d-9be0-fa9403fba810 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823" status: 200 len: 1319 microversion: 2.1 time: 0.236763 Jul 20 15:37:18.456528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 306/614] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:18 2022] GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:18.597602 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-2c2f7f02-3cfd-48f6-ae3d-22f4ef38c3a4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:18.598451 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-2c2f7f02-3cfd-48f6-ae3d-22f4ef38c3a4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:18.605706 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2c2f7f02-3cfd-48f6-ae3d-22f4ef38c3a4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:18.606203 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2c2f7f02-3cfd-48f6-ae3d-22f4ef38c3a4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:18.615119 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2c2f7f02-3cfd-48f6-ae3d-22f4ef38c3a4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:18.615119 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2c2f7f02-3cfd-48f6-ae3d-22f4ef38c3a4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:18.681465 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2c2f7f02-3cfd-48f6-ae3d-22f4ef38c3a4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:18.690357 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2c2f7f02-3cfd-48f6-ae3d-22f4ef38c3a4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:18.692252 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2c2f7f02-3cfd-48f6-ae3d-22f4ef38c3a4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:18.694003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-2c2f7f02-3cfd-48f6-ae3d-22f4ef38c3a4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1338 microversion: 2.20 time: 0.099432 Jul 20 15:37:18.694003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 309/615] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:18 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1338 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:37:19.241277 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-138e625d-9178-4518-84b8-ce83b85f91aa tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:19.241877 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-138e625d-9178-4518-84b8-ce83b85f91aa tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:19.249221 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-138e625d-9178-4518-84b8-ce83b85f91aa tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:19.249666 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-138e625d-9178-4518-84b8-ce83b85f91aa tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:19.250480 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-138e625d-9178-4518-84b8-ce83b85f91aa tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:19.250905 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-138e625d-9178-4518-84b8-ce83b85f91aa tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:19.405402 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-138e625d-9178-4518-84b8-ce83b85f91aa tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:19.415068 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-138e625d-9178-4518-84b8-ce83b85f91aa tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1685 microversion: 2.1 time: 0.178502 Jul 20 15:37:19.415646 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 307/616] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:19 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1685 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:19.452539 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-4aa1b616-7d26-4bbd-8fb7-d86d3ca3a5ac tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:19.453147 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-4aa1b616-7d26-4bbd-8fb7-d86d3ca3a5ac tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:19.461507 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4aa1b616-7d26-4bbd-8fb7-d86d3ca3a5ac tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:19.461969 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4aa1b616-7d26-4bbd-8fb7-d86d3ca3a5ac tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:19.462763 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4aa1b616-7d26-4bbd-8fb7-d86d3ca3a5ac tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:19.463227 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4aa1b616-7d26-4bbd-8fb7-d86d3ca3a5ac tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:19.473541 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-06a76fb9-cf02-4ef5-9ba2-38bc0dff4fd6 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:19.474187 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-06a76fb9-cf02-4ef5-9ba2-38bc0dff4fd6 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:19.480613 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-06a76fb9-cf02-4ef5-9ba2-38bc0dff4fd6 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:19.481200 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-06a76fb9-cf02-4ef5-9ba2-38bc0dff4fd6 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:19.482029 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-06a76fb9-cf02-4ef5-9ba2-38bc0dff4fd6 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:19.482500 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-06a76fb9-cf02-4ef5-9ba2-38bc0dff4fd6 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:19.531400 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-4aa1b616-7d26-4bbd-8fb7-d86d3ca3a5ac tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:19.539490 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-4aa1b616-7d26-4bbd-8fb7-d86d3ca3a5ac tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1296 microversion: 2.1 time: 0.091549 Jul 20 15:37:19.540088 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 310/617] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:19 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:19.629302 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-06a76fb9-cf02-4ef5-9ba2-38bc0dff4fd6 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:19.636932 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-06a76fb9-cf02-4ef5-9ba2-38bc0dff4fd6 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823" status: 200 len: 1508 microversion: 2.1 time: 0.167267 Jul 20 15:37:19.638327 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 308/618] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:19 2022] GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:19.655746 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c06e335a-1810-4389-b25f-ca88a3ac5d57 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b15efca7-0b98-4d90-a451-0b6f2b07ceac", "device": "/dev/sdb"}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:37:19.656870 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c06e335a-1810-4389-b25f-ca88a3ac5d57 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:19.663346 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c06e335a-1810-4389-b25f-ca88a3ac5d57 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:19.663809 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c06e335a-1810-4389-b25f-ca88a3ac5d57 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:19.664551 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c06e335a-1810-4389-b25f-ca88a3ac5d57 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:19.664976 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c06e335a-1810-4389-b25f-ca88a3ac5d57 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:19.711053 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b4184c2f-3848-456a-ad11-3b17685d906f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:19.711653 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b4184c2f-3848-456a-ad11-3b17685d906f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:19.717786 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b4184c2f-3848-456a-ad11-3b17685d906f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:19.718244 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b4184c2f-3848-456a-ad11-3b17685d906f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:19.719119 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b4184c2f-3848-456a-ad11-3b17685d906f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:19.719453 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b4184c2f-3848-456a-ad11-3b17685d906f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:19.859856 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b4184c2f-3848-456a-ad11-3b17685d906f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:19.867925 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b4184c2f-3848-456a-ad11-3b17685d906f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:19.869435 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b4184c2f-3848-456a-ad11-3b17685d906f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:19.870594 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b4184c2f-3848-456a-ad11-3b17685d906f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1405 microversion: 2.20 time: 0.163604 Jul 20 15:37:19.871153 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 309/619] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:19 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:37:20.432432 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-292e7165-f3d8-41e3-8b97-7166044bec43 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:20.433033 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-292e7165-f3d8-41e3-8b97-7166044bec43 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:20.440483 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-292e7165-f3d8-41e3-8b97-7166044bec43 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:20.440925 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-292e7165-f3d8-41e3-8b97-7166044bec43 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:20.441673 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-292e7165-f3d8-41e3-8b97-7166044bec43 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:20.442101 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-292e7165-f3d8-41e3-8b97-7166044bec43 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:20.573221 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-292e7165-f3d8-41e3-8b97-7166044bec43 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:20.581309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-292e7165-f3d8-41e3-8b97-7166044bec43 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1685 microversion: 2.1 time: 0.152748 Jul 20 15:37:20.581902 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 310/620] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:20 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:20.586614 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-23d64a32-7ef1-4ff4-8ee2-6882a63d539f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:20.587226 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-23d64a32-7ef1-4ff4-8ee2-6882a63d539f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:20.603969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-23d64a32-7ef1-4ff4-8ee2-6882a63d539f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:20.604414 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-23d64a32-7ef1-4ff4-8ee2-6882a63d539f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:20.605177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-23d64a32-7ef1-4ff4-8ee2-6882a63d539f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:20.605608 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-23d64a32-7ef1-4ff4-8ee2-6882a63d539f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:20.667799 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-23d64a32-7ef1-4ff4-8ee2-6882a63d539f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:20.676029 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-23d64a32-7ef1-4ff4-8ee2-6882a63d539f tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1296 microversion: 2.1 time: 0.093104 Jul 20 15:37:20.676619 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 311/621] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:20 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:20.889465 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-4220cbf3-3cff-4ddb-a508-acc5bae028e3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:20.890076 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-4220cbf3-3cff-4ddb-a508-acc5bae028e3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:20.896240 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4220cbf3-3cff-4ddb-a508-acc5bae028e3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:20.896686 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4220cbf3-3cff-4ddb-a508-acc5bae028e3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:20.897436 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4220cbf3-3cff-4ddb-a508-acc5bae028e3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:20.897868 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4220cbf3-3cff-4ddb-a508-acc5bae028e3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:21.030981 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4220cbf3-3cff-4ddb-a508-acc5bae028e3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:21.039435 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4220cbf3-3cff-4ddb-a508-acc5bae028e3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:21.040982 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4220cbf3-3cff-4ddb-a508-acc5bae028e3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:21.042068 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-4220cbf3-3cff-4ddb-a508-acc5bae028e3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1405 microversion: 2.20 time: 0.157086 Jul 20 15:37:21.042660 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 312/622] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:20 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:37:21.599632 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-eeda3fc0-05f5-483e-be55-06aef0e18259 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:21.600280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-eeda3fc0-05f5-483e-be55-06aef0e18259 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:21.607902 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-eeda3fc0-05f5-483e-be55-06aef0e18259 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:21.608379 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-eeda3fc0-05f5-483e-be55-06aef0e18259 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:21.609149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-eeda3fc0-05f5-483e-be55-06aef0e18259 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:21.609620 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-eeda3fc0-05f5-483e-be55-06aef0e18259 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:21.746287 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-eeda3fc0-05f5-483e-be55-06aef0e18259 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:21.754992 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-eeda3fc0-05f5-483e-be55-06aef0e18259 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1685 microversion: 2.1 time: 0.159170 Jul 20 15:37:21.755582 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 313/623] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:21 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:37:21.760177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-57641a6c-1c6a-44e2-9866-0d899d4b6cba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:21.760770 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-57641a6c-1c6a-44e2-9866-0d899d4b6cba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:21.766726 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-57641a6c-1c6a-44e2-9866-0d899d4b6cba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:21.767169 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-57641a6c-1c6a-44e2-9866-0d899d4b6cba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:21.767920 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-57641a6c-1c6a-44e2-9866-0d899d4b6cba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:21.768564 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-57641a6c-1c6a-44e2-9866-0d899d4b6cba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:21.940383 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-57641a6c-1c6a-44e2-9866-0d899d4b6cba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:21.940383 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-57641a6c-1c6a-44e2-9866-0d899d4b6cba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1296 microversion: 2.1 time: 0.086399 Jul 20 15:37:21.940383 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 314/624] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:21 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1296 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:22.060555 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-4894bc63-fd23-458b-a6c2-670b5e79172b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:22.061160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-4894bc63-fd23-458b-a6c2-670b5e79172b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:22.067650 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4894bc63-fd23-458b-a6c2-670b5e79172b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:22.068106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4894bc63-fd23-458b-a6c2-670b5e79172b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:22.068875 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4894bc63-fd23-458b-a6c2-670b5e79172b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:22.069312 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4894bc63-fd23-458b-a6c2-670b5e79172b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:22.223120 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4894bc63-fd23-458b-a6c2-670b5e79172b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:22.231353 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4894bc63-fd23-458b-a6c2-670b5e79172b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:22.232874 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4894bc63-fd23-458b-a6c2-670b5e79172b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:22.233983 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-4894bc63-fd23-458b-a6c2-670b5e79172b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1405 microversion: 2.20 time: 0.177689 Jul 20 15:37:22.234577 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 315/625] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:22 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:37:22.780463 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-4bde2a6d-f35a-439a-b709-b5352265a4d4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:22.780980 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-4bde2a6d-f35a-439a-b709-b5352265a4d4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:22.783755 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:22.789684 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4bde2a6d-f35a-439a-b709-b5352265a4d4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:22.790134 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4bde2a6d-f35a-439a-b709-b5352265a4d4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:22.790923 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4bde2a6d-f35a-439a-b709-b5352265a4d4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:22.791368 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4bde2a6d-f35a-439a-b709-b5352265a4d4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:22.942929 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4bde2a6d-f35a-439a-b709-b5352265a4d4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:22.951169 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-4bde2a6d-f35a-439a-b709-b5352265a4d4 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1685 microversion: 2.1 time: 0.176100 Jul 20 15:37:22.953800 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 316/626] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:22 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:37:22.975628 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-4b611602-e511-4df9-8d99-5affa4b82be9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:22.979858 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-4b611602-e511-4df9-8d99-5affa4b82be9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:22.983980 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4b611602-e511-4df9-8d99-5affa4b82be9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:22.984451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4b611602-e511-4df9-8d99-5affa4b82be9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:22.985921 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4b611602-e511-4df9-8d99-5affa4b82be9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:22.986402 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4b611602-e511-4df9-8d99-5affa4b82be9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:23.112101 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4b611602-e511-4df9-8d99-5affa4b82be9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:23.122181 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-4b611602-e511-4df9-8d99-5affa4b82be9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1306 microversion: 2.1 time: 0.162329 Jul 20 15:37:23.123051 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 317/627] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:22 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1306 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:23.257350 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e050de47-7ba3-467c-8439-6f1d7bcfb9e2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:23.263287 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e050de47-7ba3-467c-8439-6f1d7bcfb9e2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:23.271447 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e050de47-7ba3-467c-8439-6f1d7bcfb9e2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:23.272558 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e050de47-7ba3-467c-8439-6f1d7bcfb9e2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:23.273954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e050de47-7ba3-467c-8439-6f1d7bcfb9e2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:23.275870 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e050de47-7ba3-467c-8439-6f1d7bcfb9e2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:23.680951 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c06e335a-1810-4389-b25f-ca88a3ac5d57 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "POST /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.028950 Jul 20 15:37:23.682411 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 311/628] 10.222.0.78 () {60 vars in 1322 bytes} [Wed Jul 20 15:37:19 2022] POST /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823/os-volume_attachments => generated 194 bytes in 4032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:37:23.723971 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-e050de47-7ba3-467c-8439-6f1d7bcfb9e2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:23.737483 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-e050de47-7ba3-467c-8439-6f1d7bcfb9e2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:23.742579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-e050de47-7ba3-467c-8439-6f1d7bcfb9e2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:23.742579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-e050de47-7ba3-467c-8439-6f1d7bcfb9e2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1405 microversion: 2.20 time: 0.491610 Jul 20 15:37:23.742579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 318/629] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:23 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1405 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:37:23.984864 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-156f4ee6-83b4-4092-a9d8-01eaef1779eb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:23.986164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-156f4ee6-83b4-4092-a9d8-01eaef1779eb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:23.998709 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-156f4ee6-83b4-4092-a9d8-01eaef1779eb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:23.999505 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-156f4ee6-83b4-4092-a9d8-01eaef1779eb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:24.001184 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-156f4ee6-83b4-4092-a9d8-01eaef1779eb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:24.001972 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-156f4ee6-83b4-4092-a9d8-01eaef1779eb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:24.052586 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=2 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:24.140787 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-dccfad13-102c-41ef-8ca9-3dcc600d1b35 req-555b7065-da73-425c-bed0-a559277d2340 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1f04603-2085-4cc0-8263-d9c95c31f8a7", "tag": "a14d5f16-fe56-45ba-b07b-4affc5762962"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:37:24.159337 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-dccfad13-102c-41ef-8ca9-3dcc600d1b35 req-555b7065-da73-425c-bed0-a559277d2340 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:24.160170 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-dccfad13-102c-41ef-8ca9-3dcc600d1b35 req-555b7065-da73-425c-bed0-a559277d2340 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:24.179728 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-dccfad13-102c-41ef-8ca9-3dcc600d1b35 req-555b7065-da73-425c-bed0-a559277d2340 service nova] Creating event network-changed:a14d5f16-fe56-45ba-b07b-4affc5762962 for instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 on hv-cinder-81914 Jul 20 15:37:24.196317 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-dccfad13-102c-41ef-8ca9-3dcc600d1b35 req-555b7065-da73-425c-bed0-a559277d2340 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149111 Jul 20 15:37:24.199004 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 319/630] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:37:24.207905 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-6d93a236-5bf6-4c54-b026-2243487e6d73 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:24.209682 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-6d93a236-5bf6-4c54-b026-2243487e6d73 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:24.220196 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6d93a236-5bf6-4c54-b026-2243487e6d73 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:24.221984 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6d93a236-5bf6-4c54-b026-2243487e6d73 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:24.223688 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6d93a236-5bf6-4c54-b026-2243487e6d73 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:24.225236 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6d93a236-5bf6-4c54-b026-2243487e6d73 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:24.378852 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-156f4ee6-83b4-4092-a9d8-01eaef1779eb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:24.390397 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-156f4ee6-83b4-4092-a9d8-01eaef1779eb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1685 microversion: 2.1 time: 0.413926 Jul 20 15:37:24.391207 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 312/631] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:23 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1685 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:24.738769 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-6d93a236-5bf6-4c54-b026-2243487e6d73 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:24.753275 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-6d93a236-5bf6-4c54-b026-2243487e6d73 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1362 microversion: 2.1 time: 0.549954 Jul 20 15:37:24.755526 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 320/632] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:24 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1362 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:24.769036 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-1f352e74-2234-4ca0-a5ab-4b1500b31406 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:24.774445 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-1f352e74-2234-4ca0-a5ab-4b1500b31406 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:24.804892 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=2 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:24.842117 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=12 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:24.866082 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1f352e74-2234-4ca0-a5ab-4b1500b31406 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:24.870342 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1f352e74-2234-4ca0-a5ab-4b1500b31406 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:24.871074 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1f352e74-2234-4ca0-a5ab-4b1500b31406 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:24.872261 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1f352e74-2234-4ca0-a5ab-4b1500b31406 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:25.054682 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=22 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:25.092910 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-06754325-b49e-4df7-b4d9-0e2bb39ad33d req-118d6476-51bb-4e01-bc60-36c2de303a33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91beb453-6320-472a-951c-3fda16747994", "name": "network-vif-deleted", "tag": "e2135397-d828-46e2-a219-f788f406eb08"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:37:25.101133 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-1f352e74-2234-4ca0-a5ab-4b1500b31406 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:25.102003 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-06754325-b49e-4df7-b4d9-0e2bb39ad33d req-118d6476-51bb-4e01-bc60-36c2de303a33 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:25.102469 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-06754325-b49e-4df7-b4d9-0e2bb39ad33d req-118d6476-51bb-4e01-bc60-36c2de303a33 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:25.111577 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-1f352e74-2234-4ca0-a5ab-4b1500b31406 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:25.113134 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-1f352e74-2234-4ca0-a5ab-4b1500b31406 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:25.114282 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-1f352e74-2234-4ca0-a5ab-4b1500b31406 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1405 microversion: 2.20 time: 0.355950 Jul 20 15:37:25.114844 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 313/633] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:24 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1405 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:37:25.116645 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-06754325-b49e-4df7-b4d9-0e2bb39ad33d req-118d6476-51bb-4e01-bc60-36c2de303a33 service nova] Creating event network-vif-deleted:e2135397-d828-46e2-a219-f788f406eb08 for instance 91beb453-6320-472a-951c-3fda16747994 on hv-cinder-81914 Jul 20 15:37:25.122195 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-06754325-b49e-4df7-b4d9-0e2bb39ad33d req-118d6476-51bb-4e01-bc60-36c2de303a33 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107324 Jul 20 15:37:25.123173 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 321/634] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:37:25.409944 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-6436d723-5627-4b94-aebb-848e463a0662 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:25.411064 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-6436d723-5627-4b94-aebb-848e463a0662 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:25.421160 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6436d723-5627-4b94-aebb-848e463a0662 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:25.421892 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6436d723-5627-4b94-aebb-848e463a0662 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:25.422924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6436d723-5627-4b94-aebb-848e463a0662 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:25.424272 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6436d723-5627-4b94-aebb-848e463a0662 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:25.497479 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-6436d723-5627-4b94-aebb-848e463a0662 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:25.506046 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-6436d723-5627-4b94-aebb-848e463a0662 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1620 microversion: 2.1 time: 0.100980 Jul 20 15:37:25.506747 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 314/635] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:25 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1620 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:25.773370 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-c804b6dc-8c30-4e73-a17d-6be4a28d86ea tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:25.774383 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-c804b6dc-8c30-4e73-a17d-6be4a28d86ea tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:25.782251 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c804b6dc-8c30-4e73-a17d-6be4a28d86ea tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:25.782732 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c804b6dc-8c30-4e73-a17d-6be4a28d86ea tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:25.783513 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c804b6dc-8c30-4e73-a17d-6be4a28d86ea tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:25.783958 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c804b6dc-8c30-4e73-a17d-6be4a28d86ea tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:25.942464 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-c804b6dc-8c30-4e73-a17d-6be4a28d86ea tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:25.954662 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-c804b6dc-8c30-4e73-a17d-6be4a28d86ea tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1362 microversion: 2.1 time: 0.186200 Jul 20 15:37:25.955239 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 322/636] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:25 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:26.133564 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5e077764-1188-4c3f-a721-8722d63439ff tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:26.134146 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5e077764-1188-4c3f-a721-8722d63439ff tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:26.147396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e077764-1188-4c3f-a721-8722d63439ff tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:26.147396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e077764-1188-4c3f-a721-8722d63439ff tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:26.147396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e077764-1188-4c3f-a721-8722d63439ff tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:26.147396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e077764-1188-4c3f-a721-8722d63439ff tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:26.264263 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-64dfdc9c-0d60-45b5-bba2-3851116f0e39 req-4aba41f0-d666-4457-a327-280ab12adc67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0f28926-7b36-49a2-bd27-7b7006fa992e", "tag": "3aaaffa8-35ca-428a-a369-dca539b96513"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:37:26.280785 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-64dfdc9c-0d60-45b5-bba2-3851116f0e39 req-4aba41f0-d666-4457-a327-280ab12adc67 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:26.281247 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-64dfdc9c-0d60-45b5-bba2-3851116f0e39 req-4aba41f0-d666-4457-a327-280ab12adc67 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:26.284121 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:26.294112 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-64dfdc9c-0d60-45b5-bba2-3851116f0e39 req-4aba41f0-d666-4457-a327-280ab12adc67 service nova] Creating event network-changed:3aaaffa8-35ca-428a-a369-dca539b96513 for instance a0f28926-7b36-49a2-bd27-7b7006fa992e on hv-cinder-81914 Jul 20 15:37:26.299863 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-64dfdc9c-0d60-45b5-bba2-3851116f0e39 req-4aba41f0-d666-4457-a327-280ab12adc67 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040079 Jul 20 15:37:26.300859 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 323/637] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:37:26.434600 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5e077764-1188-4c3f-a721-8722d63439ff tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:26.443310 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5e077764-1188-4c3f-a721-8722d63439ff tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:26.444955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5e077764-1188-4c3f-a721-8722d63439ff tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:26.446132 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5e077764-1188-4c3f-a721-8722d63439ff tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1405 microversion: 2.20 time: 0.316819 Jul 20 15:37:26.446826 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 315/638] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:26 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1405 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:37:26.524619 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-f8b84ebe-8f27-47cd-8531-d215da3095af tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:26.525317 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-f8b84ebe-8f27-47cd-8531-d215da3095af tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:26.532961 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f8b84ebe-8f27-47cd-8531-d215da3095af tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:26.533415 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f8b84ebe-8f27-47cd-8531-d215da3095af tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:26.534194 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f8b84ebe-8f27-47cd-8531-d215da3095af tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:26.534724 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f8b84ebe-8f27-47cd-8531-d215da3095af tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:26.567075 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f8b84ebe-8f27-47cd-8531-d215da3095af tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:26.567535 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f8b84ebe-8f27-47cd-8531-d215da3095af tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:26.567988 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.objects.instance [None req-f8b84ebe-8f27-47cd-8531-d215da3095af tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lazy-loading 'fault' on Instance uuid 91beb453-6320-472a-951c-3fda16747994 {{(pid=124712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:37:26.615353 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-f8b84ebe-8f27-47cd-8531-d215da3095af tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:26.624582 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-f8b84ebe-8f27-47cd-8531-d215da3095af tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1335 microversion: 2.1 time: 0.104153 Jul 20 15:37:26.625963 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 324/639] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:26 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1335 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:26.972581 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-357eeb1c-9167-47b3-8799-24e58ac86d55 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:26.973214 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-357eeb1c-9167-47b3-8799-24e58ac86d55 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:26.986605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-357eeb1c-9167-47b3-8799-24e58ac86d55 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:26.986605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-357eeb1c-9167-47b3-8799-24e58ac86d55 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:26.986605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-357eeb1c-9167-47b3-8799-24e58ac86d55 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:26.986605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-357eeb1c-9167-47b3-8799-24e58ac86d55 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:27.119626 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-357eeb1c-9167-47b3-8799-24e58ac86d55 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:27.127916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-357eeb1c-9167-47b3-8799-24e58ac86d55 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1362 microversion: 2.1 time: 0.159327 Jul 20 15:37:27.128494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 316/640] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:26 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:27.465815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-3c8034bb-0eaf-4afe-9e4e-c9c73c2aff80 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:27.466395 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-3c8034bb-0eaf-4afe-9e4e-c9c73c2aff80 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:27.473461 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3c8034bb-0eaf-4afe-9e4e-c9c73c2aff80 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:27.473940 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3c8034bb-0eaf-4afe-9e4e-c9c73c2aff80 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:27.474749 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3c8034bb-0eaf-4afe-9e4e-c9c73c2aff80 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:27.475179 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3c8034bb-0eaf-4afe-9e4e-c9c73c2aff80 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:27.617238 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-3c8034bb-0eaf-4afe-9e4e-c9c73c2aff80 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:27.626542 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-3c8034bb-0eaf-4afe-9e4e-c9c73c2aff80 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:27.630943 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-3c8034bb-0eaf-4afe-9e4e-c9c73c2aff80 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:27.630943 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-3c8034bb-0eaf-4afe-9e4e-c9c73c2aff80 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1405 microversion: 2.20 time: 0.167935 Jul 20 15:37:27.630943 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 325/641] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:27 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:37:27.640900 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e5fc1fd3-c8e5-44b5-b0d4-db3192840f25 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:27.641516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e5fc1fd3-c8e5-44b5-b0d4-db3192840f25 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:27.648384 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e5fc1fd3-c8e5-44b5-b0d4-db3192840f25 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:27.648839 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e5fc1fd3-c8e5-44b5-b0d4-db3192840f25 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:27.649625 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e5fc1fd3-c8e5-44b5-b0d4-db3192840f25 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:27.650070 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e5fc1fd3-c8e5-44b5-b0d4-db3192840f25 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:27.683770 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e5fc1fd3-c8e5-44b5-b0d4-db3192840f25 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:27.684219 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e5fc1fd3-c8e5-44b5-b0d4-db3192840f25 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:27.684671 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.objects.instance [None req-e5fc1fd3-c8e5-44b5-b0d4-db3192840f25 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lazy-loading 'fault' on Instance uuid 91beb453-6320-472a-951c-3fda16747994 {{(pid=124711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:37:27.729639 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e5fc1fd3-c8e5-44b5-b0d4-db3192840f25 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:27.739685 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e5fc1fd3-c8e5-44b5-b0d4-db3192840f25 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 200 len: 1335 microversion: 2.1 time: 0.102595 Jul 20 15:37:27.740256 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 317/642] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:27 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 1335 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:28.145910 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-ca4dae8f-7e53-4bb5-acfa-fa6f6fefb783 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:28.146617 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-ca4dae8f-7e53-4bb5-acfa-fa6f6fefb783 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:28.156098 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ca4dae8f-7e53-4bb5-acfa-fa6f6fefb783 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:28.156618 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ca4dae8f-7e53-4bb5-acfa-fa6f6fefb783 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:28.157458 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ca4dae8f-7e53-4bb5-acfa-fa6f6fefb783 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:28.157950 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ca4dae8f-7e53-4bb5-acfa-fa6f6fefb783 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:28.373404 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-ca4dae8f-7e53-4bb5-acfa-fa6f6fefb783 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:28.381318 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-ca4dae8f-7e53-4bb5-acfa-fa6f6fefb783 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1362 microversion: 2.1 time: 0.239962 Jul 20 15:37:28.381909 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 326/643] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:28 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:37:28.649204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-853ca048-d8db-49db-a2ae-d58f49ac2915 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:28.649870 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-853ca048-d8db-49db-a2ae-d58f49ac2915 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:28.657049 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-853ca048-d8db-49db-a2ae-d58f49ac2915 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:28.657502 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-853ca048-d8db-49db-a2ae-d58f49ac2915 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:28.658718 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-853ca048-d8db-49db-a2ae-d58f49ac2915 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:28.658983 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-853ca048-d8db-49db-a2ae-d58f49ac2915 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:28.677229 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:28.757436 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-dbf63f13-def7-4dae-854f-9740d3a81089 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:28.758033 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-dbf63f13-def7-4dae-854f-9740d3a81089 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 91beb453-6320-472a-951c-3fda16747994] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:28.767190 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dbf63f13-def7-4dae-854f-9740d3a81089 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:28.767654 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dbf63f13-def7-4dae-854f-9740d3a81089 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:28.768438 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dbf63f13-def7-4dae-854f-9740d3a81089 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:28.768912 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dbf63f13-def7-4dae-854f-9740d3a81089 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:28.783874 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-dbf63f13-def7-4dae-854f-9740d3a81089 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] HTTP exception thrown: Instance 91beb453-6320-472a-951c-3fda16747994 could not be found. Jul 20 15:37:28.787143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-dbf63f13-def7-4dae-854f-9740d3a81089 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Request method failure captured: Jul 20 15:37:28.787143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 HTTP/1.1 Jul 20 15:37:28.787143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:37:28.787143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:37:28.787143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:37:28.787143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:37:28.787143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:37:28.787143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:37:28.787143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:37:28.787143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:37:28.787143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2B_nGe2iOCK4tpUXv7QabEEnZaZW6RYPqleka0psoTfCGUPxAgJvaFOHiUD5txfR4A4Hv1RzSFAd2v9PbHR17R2ddNfAKs2jQu_tXTgNRWpbrjgsTUb2vYhREm-bYeMJTibFF78_Vxw9bGxCNNDb--ZMo_XhlRZwYM49r3qyh0pb7pM Jul 20 15:37:28.787143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:37:28.787143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:37:28.787143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:37:28.787143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:37:28.787143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:37:28.787143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:37:28.787143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 61872ef687074f5791a2cc46732bebdf Jul 20 15:37:28.787143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1769185307 Jul 20 15:37:28.787143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:37:28.787143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:37:28.788513 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/61872ef687074f5791a2cc46732bebdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/61872ef687074f5791a2cc46732bebdf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_61872ef687074f5791a2cc46732bebdf", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/61872ef687074f5791a2cc46732bebdf"}]}] Jul 20 15:37:28.788513 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1769185307 Jul 20 15:37:28.788513 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 61872ef687074f5791a2cc46732bebdf Jul 20 15:37:28.788513 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1769185307 Jul 20 15:37:28.788513 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-ServerRescueNegativeTestJSON-1769185307-project Jul 20 15:37:28.788513 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:37:28.788513 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:37:28.788513 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: ebbcfe6341a3486d93e12c09f83954dc Jul 20 15:37:28.788513 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1769185307-project Jul 20 15:37:28.788513 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:37:28.788513 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance 91beb453-6320-472a-951c-3fda16747994 could not be found. Jul 20 15:37:28.788513 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': '91beb453-6320-472a-951c-3fda16747994'} Jul 20 15:37:28.789503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:37:28.789503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:37:28.789503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:37:28.789503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:37:28.789503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:37:28.789503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:37:28.789503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:37:28.789503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:37:28.789503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:37:28.789503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:37:28.789503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91beb453-6320-472a-951c-3fda16747994 could not be found. Jul 20 15:37:28.789503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:37:28.789503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:37:28.789503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:37:28.789503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:37:28.789503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:37:28.789503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:37:28.789503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:37:28.789503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:37:28.789503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:37:28.791460 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:37:28.791460 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:37:28.791460 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:37:28.791460 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:37:28.791460 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:37:28.791460 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:37:28.791460 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:37:28.791460 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91beb453-6320-472a-951c-3fda16747994 could not be found. Jul 20 15:37:28.791460 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:37:28.791460 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:37:28.791460 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:37:28.791460 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:37:28.791460 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:37:28.791460 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:37:28.791460 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:37:28.791460 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:37:28.791460 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91beb453-6320-472a-951c-3fda16747994 could not be found. Jul 20 15:37:28.791460 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:37:28.794183 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-dbf63f13-def7-4dae-854f-9740d3a81089 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Returning 404 to user: Instance 91beb453-6320-472a-951c-3fda16747994 could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:37:28.794183 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-dbf63f13-def7-4dae-854f-9740d3a81089 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994" status: 404 len: 111 microversion: 2.1 time: 0.035365 Jul 20 15:37:28.794183 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 327/644] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:28 2022] GET /compute/v2.1/servers/91beb453-6320-472a-951c-3fda16747994 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 15:37:28.797944 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-9f6f6973-ce6a-4ee9-b576-9c5729a8186d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '.version_select at 0x7efd90a54dc0>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:28.873174 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-853ca048-d8db-49db-a2ae-d58f49ac2915 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:28.881428 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-853ca048-d8db-49db-a2ae-d58f49ac2915 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:28.883004 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-853ca048-d8db-49db-a2ae-d58f49ac2915 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:28.884128 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-853ca048-d8db-49db-a2ae-d58f49ac2915 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1405 microversion: 2.20 time: 0.239972 Jul 20 15:37:28.884709 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 318/645] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:28 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1405 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:37:28.898577 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-9f6f6973-ce6a-4ee9-b576-9c5729a8186d tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1783439801" status: 202 len: 0 microversion: 2.1 time: 0.104124 Jul 20 15:37:28.899154 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 328/646] 10.222.0.78 () {58 vars in 1220 bytes} [Wed Jul 20 15:37:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1783439801 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:37:29.398746 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-701da1d3-8679-449a-bf06-6dbf753912a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:29.399357 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-701da1d3-8679-449a-bf06-6dbf753912a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:29.405930 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-701da1d3-8679-449a-bf06-6dbf753912a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:29.406740 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-701da1d3-8679-449a-bf06-6dbf753912a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:29.407513 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-701da1d3-8679-449a-bf06-6dbf753912a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:29.407953 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-701da1d3-8679-449a-bf06-6dbf753912a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:29.547296 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-701da1d3-8679-449a-bf06-6dbf753912a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:29.555574 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-701da1d3-8679-449a-bf06-6dbf753912a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1362 microversion: 2.1 time: 0.160636 Jul 20 15:37:29.559796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 319/647] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:29 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:29.903154 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b80d0926-3530-4606-9368-76313ce24382 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:29.903748 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b80d0926-3530-4606-9368-76313ce24382 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:29.910048 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b80d0926-3530-4606-9368-76313ce24382 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:29.910531 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b80d0926-3530-4606-9368-76313ce24382 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:29.911291 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b80d0926-3530-4606-9368-76313ce24382 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:29.911721 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b80d0926-3530-4606-9368-76313ce24382 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:30.106873 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b80d0926-3530-4606-9368-76313ce24382 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:30.115864 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b80d0926-3530-4606-9368-76313ce24382 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:30.117442 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b80d0926-3530-4606-9368-76313ce24382 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:30.118662 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b80d0926-3530-4606-9368-76313ce24382 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1405 microversion: 2.20 time: 0.220118 Jul 20 15:37:30.119747 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 329/648] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:29 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1405 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:37:30.182610 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-7e951229-d4ce-4df6-b933-ba18f58e287b req-61bc6c67-1a57-4ab0-b4df-4de8ee15b891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1f04603-2085-4cc0-8263-d9c95c31f8a7", "name": "network-vif-plugged", "status": "completed", "tag": "a14d5f16-fe56-45ba-b07b-4affc5762962"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:37:30.192092 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-7e951229-d4ce-4df6-b933-ba18f58e287b req-61bc6c67-1a57-4ab0-b4df-4de8ee15b891 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:30.192557 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-7e951229-d4ce-4df6-b933-ba18f58e287b req-61bc6c67-1a57-4ab0-b4df-4de8ee15b891 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:30.205010 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-7e951229-d4ce-4df6-b933-ba18f58e287b req-61bc6c67-1a57-4ab0-b4df-4de8ee15b891 service nova] Creating event network-vif-plugged:a14d5f16-fe56-45ba-b07b-4affc5762962 for instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 on hv-cinder-81914 Jul 20 15:37:30.216181 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-7e951229-d4ce-4df6-b933-ba18f58e287b req-61bc6c67-1a57-4ab0-b4df-4de8ee15b891 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037377 Jul 20 15:37:30.216843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 320/649] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:37:30.579781 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-9eeded84-0e48-432a-8b36-e9f975ae31c3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:30.581349 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-9eeded84-0e48-432a-8b36-e9f975ae31c3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:30.592710 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9eeded84-0e48-432a-8b36-e9f975ae31c3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:30.599155 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9eeded84-0e48-432a-8b36-e9f975ae31c3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:30.599155 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9eeded84-0e48-432a-8b36-e9f975ae31c3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:30.599155 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9eeded84-0e48-432a-8b36-e9f975ae31c3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:30.756221 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-9eeded84-0e48-432a-8b36-e9f975ae31c3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:30.763958 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-9eeded84-0e48-432a-8b36-e9f975ae31c3 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1362 microversion: 2.1 time: 0.192686 Jul 20 15:37:30.764531 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 330/650] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:30 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:31.140088 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5cbfc3f3-ab14-4118-9a56-24d1a138d582 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:31.140782 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5cbfc3f3-ab14-4118-9a56-24d1a138d582 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:31.147872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5cbfc3f3-ab14-4118-9a56-24d1a138d582 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:31.148327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5cbfc3f3-ab14-4118-9a56-24d1a138d582 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:31.149088 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5cbfc3f3-ab14-4118-9a56-24d1a138d582 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:31.149523 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5cbfc3f3-ab14-4118-9a56-24d1a138d582 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:31.303351 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5cbfc3f3-ab14-4118-9a56-24d1a138d582 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:31.312535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5cbfc3f3-ab14-4118-9a56-24d1a138d582 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:31.314065 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5cbfc3f3-ab14-4118-9a56-24d1a138d582 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:31.315191 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5cbfc3f3-ab14-4118-9a56-24d1a138d582 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1405 microversion: 2.20 time: 0.180451 Jul 20 15:37:31.315751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 321/651] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:31 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:37:31.780756 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-3d80b787-161a-4102-9368-c4b739d1f7c8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:31.781363 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-3d80b787-161a-4102-9368-c4b739d1f7c8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:31.787935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3d80b787-161a-4102-9368-c4b739d1f7c8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:31.788388 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3d80b787-161a-4102-9368-c4b739d1f7c8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:31.789153 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3d80b787-161a-4102-9368-c4b739d1f7c8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:31.789591 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3d80b787-161a-4102-9368-c4b739d1f7c8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:31.940843 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-3d80b787-161a-4102-9368-c4b739d1f7c8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:31.948349 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-3d80b787-161a-4102-9368-c4b739d1f7c8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1362 microversion: 2.1 time: 0.171510 Jul 20 15:37:31.948911 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 331/652] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:31 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:37:32.250165 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-324f37ca-cc34-46f0-8d66-a84fed313969 req-da6be032-253f-4218-b576-f22b9b60aed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0f28926-7b36-49a2-bd27-7b7006fa992e", "name": "network-vif-plugged", "status": "completed", "tag": "3aaaffa8-35ca-428a-a369-dca539b96513"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:37:32.262923 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-324f37ca-cc34-46f0-8d66-a84fed313969 req-da6be032-253f-4218-b576-f22b9b60aed3 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:32.267081 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-324f37ca-cc34-46f0-8d66-a84fed313969 req-da6be032-253f-4218-b576-f22b9b60aed3 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:32.275346 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-324f37ca-cc34-46f0-8d66-a84fed313969 req-da6be032-253f-4218-b576-f22b9b60aed3 service nova] Creating event network-vif-plugged:3aaaffa8-35ca-428a-a369-dca539b96513 for instance a0f28926-7b36-49a2-bd27-7b7006fa992e on hv-cinder-81914 Jul 20 15:37:32.280911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-324f37ca-cc34-46f0-8d66-a84fed313969 req-da6be032-253f-4218-b576-f22b9b60aed3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035147 Jul 20 15:37:32.288721 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 322/653] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:37:32.334453 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-4fff1db0-f0b2-47f1-829f-218c505011f8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:32.335070 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-4fff1db0-f0b2-47f1-829f-218c505011f8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:32.341822 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4fff1db0-f0b2-47f1-829f-218c505011f8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:32.342293 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4fff1db0-f0b2-47f1-829f-218c505011f8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:32.343071 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4fff1db0-f0b2-47f1-829f-218c505011f8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:32.343511 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4fff1db0-f0b2-47f1-829f-218c505011f8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:32.380020 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-0cc4a4a7-8464-44d7-b7ad-8a3e7974d350 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:32.381284 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-0cc4a4a7-8464-44d7-b7ad-8a3e7974d350 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:32.388608 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0cc4a4a7-8464-44d7-b7ad-8a3e7974d350 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:32.391481 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0cc4a4a7-8464-44d7-b7ad-8a3e7974d350 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:32.391481 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0cc4a4a7-8464-44d7-b7ad-8a3e7974d350 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:32.391481 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0cc4a4a7-8464-44d7-b7ad-8a3e7974d350 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:32.421244 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-0cc4a4a7-8464-44d7-b7ad-8a3e7974d350 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Going to try to terminate instance {{(pid=124711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 15:37:32.495506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4fff1db0-f0b2-47f1-829f-218c505011f8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:32.503602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4fff1db0-f0b2-47f1-829f-218c505011f8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:32.505100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4fff1db0-f0b2-47f1-829f-218c505011f8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:32.506274 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-4fff1db0-f0b2-47f1-829f-218c505011f8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1405 microversion: 2.20 time: 0.175978 Jul 20 15:37:32.506844 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 332/654] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:32 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:37:32.788262 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-0cc4a4a7-8464-44d7-b7ad-8a3e7974d350 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 204 len: 0 microversion: 2.1 time: 0.412994 Jul 20 15:37:32.788982 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 323/655] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:37:32 2022] DELETE /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 15:37:32.797705 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-a719935a-2e0f-40fa-bf93-363781a2f253 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:32.798421 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-a719935a-2e0f-40fa-bf93-363781a2f253 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:32.805067 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a719935a-2e0f-40fa-bf93-363781a2f253 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:32.805520 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a719935a-2e0f-40fa-bf93-363781a2f253 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:32.806310 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a719935a-2e0f-40fa-bf93-363781a2f253 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:32.806839 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a719935a-2e0f-40fa-bf93-363781a2f253 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:32.938652 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-a719935a-2e0f-40fa-bf93-363781a2f253 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:32.946223 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-a719935a-2e0f-40fa-bf93-363781a2f253 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1506 microversion: 2.1 time: 0.152395 Jul 20 15:37:32.946926 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 333/656] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:32 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:32.968562 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-4c5007ec-448b-4d22-9c59-ca49f82e9743 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:32.969326 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-4c5007ec-448b-4d22-9c59-ca49f82e9743 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:32.975808 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4c5007ec-448b-4d22-9c59-ca49f82e9743 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:32.976336 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4c5007ec-448b-4d22-9c59-ca49f82e9743 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:32.977318 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4c5007ec-448b-4d22-9c59-ca49f82e9743 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:32.977770 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4c5007ec-448b-4d22-9c59-ca49f82e9743 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:33.118198 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-4c5007ec-448b-4d22-9c59-ca49f82e9743 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:33.126002 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-4c5007ec-448b-4d22-9c59-ca49f82e9743 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1362 microversion: 2.1 time: 0.162215 Jul 20 15:37:33.126574 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 324/657] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:32 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:37:33.525020 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-78bbe77e-493b-471a-b14e-c3f2ae6a7d1d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:33.525626 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-78bbe77e-493b-471a-b14e-c3f2ae6a7d1d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:33.532581 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-78bbe77e-493b-471a-b14e-c3f2ae6a7d1d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:33.533019 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-78bbe77e-493b-471a-b14e-c3f2ae6a7d1d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:33.533783 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-78bbe77e-493b-471a-b14e-c3f2ae6a7d1d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:33.534208 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-78bbe77e-493b-471a-b14e-c3f2ae6a7d1d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:33.670821 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-78bbe77e-493b-471a-b14e-c3f2ae6a7d1d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:33.677456 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-78bbe77e-493b-471a-b14e-c3f2ae6a7d1d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:33.678997 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-78bbe77e-493b-471a-b14e-c3f2ae6a7d1d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:33.680143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-78bbe77e-493b-471a-b14e-c3f2ae6a7d1d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1597 microversion: 2.20 time: 0.159091 Jul 20 15:37:33.680700 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 334/658] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:37:33 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1597 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:37:33.697995 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-862b85d0-8669-4492-aa32-7301fc64538f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:33.698571 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-862b85d0-8669-4492-aa32-7301fc64538f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:33.705637 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-862b85d0-8669-4492-aa32-7301fc64538f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:33.706073 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-862b85d0-8669-4492-aa32-7301fc64538f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:33.706873 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-862b85d0-8669-4492-aa32-7301fc64538f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:33.707302 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-862b85d0-8669-4492-aa32-7301fc64538f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:33.789283 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-862b85d0-8669-4492-aa32-7301fc64538f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095119 Jul 20 15:37:33.790035 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 325/659] 10.222.0.78 () {60 vars in 1315 bytes} [Wed Jul 20 15:37:33 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 15:37:33.964649 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-35460e4f-23d6-4257-9118-4addcd55a0fb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:33.965242 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-35460e4f-23d6-4257-9118-4addcd55a0fb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:33.971861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-35460e4f-23d6-4257-9118-4addcd55a0fb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:33.972304 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-35460e4f-23d6-4257-9118-4addcd55a0fb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:33.973063 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-35460e4f-23d6-4257-9118-4addcd55a0fb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:33.973506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-35460e4f-23d6-4257-9118-4addcd55a0fb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:34.143356 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-9869c5a2-475a-4ce0-a8ad-28066a457232 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:34.144081 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-9869c5a2-475a-4ce0-a8ad-28066a457232 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:34.150887 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9869c5a2-475a-4ce0-a8ad-28066a457232 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:34.151465 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9869c5a2-475a-4ce0-a8ad-28066a457232 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:34.152625 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9869c5a2-475a-4ce0-a8ad-28066a457232 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:34.153066 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9869c5a2-475a-4ce0-a8ad-28066a457232 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:34.292262 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-35460e4f-23d6-4257-9118-4addcd55a0fb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:34.300521 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-35460e4f-23d6-4257-9118-4addcd55a0fb tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1506 microversion: 2.1 time: 0.339734 Jul 20 15:37:34.301167 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 335/660] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:33 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1506 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:34.400800 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-9869c5a2-475a-4ce0-a8ad-28066a457232 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:34.408943 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-9869c5a2-475a-4ce0-a8ad-28066a457232 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1362 microversion: 2.1 time: 0.269400 Jul 20 15:37:34.409726 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 326/661] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:34 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:37:35.227520 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-a29a83a1-0670-4330-8aff-400cf50b7e55 req-c45c6f1e-4861-4980-bb2d-9ea0dfbc4c7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1f04603-2085-4cc0-8263-d9c95c31f8a7", "tag": "a14d5f16-fe56-45ba-b07b-4affc5762962"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:37:35.237529 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-a29a83a1-0670-4330-8aff-400cf50b7e55 req-c45c6f1e-4861-4980-bb2d-9ea0dfbc4c7c service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:35.237971 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-a29a83a1-0670-4330-8aff-400cf50b7e55 req-c45c6f1e-4861-4980-bb2d-9ea0dfbc4c7c service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:35.254910 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-a29a83a1-0670-4330-8aff-400cf50b7e55 req-c45c6f1e-4861-4980-bb2d-9ea0dfbc4c7c service nova] Creating event network-changed:a14d5f16-fe56-45ba-b07b-4affc5762962 for instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 on hv-cinder-81914 Jul 20 15:37:35.260608 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-a29a83a1-0670-4330-8aff-400cf50b7e55 req-c45c6f1e-4861-4980-bb2d-9ea0dfbc4c7c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036923 Jul 20 15:37:35.261217 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 336/662] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:37:35.318646 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-169f6966-9cea-4748-b4cc-a30809a785ba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:35.319340 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-169f6966-9cea-4748-b4cc-a30809a785ba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:35.326350 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-169f6966-9cea-4748-b4cc-a30809a785ba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:35.326742 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-169f6966-9cea-4748-b4cc-a30809a785ba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:35.327529 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-169f6966-9cea-4748-b4cc-a30809a785ba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:35.327963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-169f6966-9cea-4748-b4cc-a30809a785ba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:35.430154 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-6c620c20-2a45-41f9-acca-a814b7a0b3ba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:35.431650 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-6c620c20-2a45-41f9-acca-a814b7a0b3ba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:35.439222 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6c620c20-2a45-41f9-acca-a814b7a0b3ba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:35.440642 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6c620c20-2a45-41f9-acca-a814b7a0b3ba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:35.440642 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6c620c20-2a45-41f9-acca-a814b7a0b3ba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:35.441213 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6c620c20-2a45-41f9-acca-a814b7a0b3ba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:35.472162 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-169f6966-9cea-4748-b4cc-a30809a785ba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:35.486106 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-169f6966-9cea-4748-b4cc-a30809a785ba tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1506 microversion: 2.1 time: 0.170817 Jul 20 15:37:35.498301 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 327/663] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:35 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:35.614585 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-6c620c20-2a45-41f9-acca-a814b7a0b3ba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:35.623639 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-6c620c20-2a45-41f9-acca-a814b7a0b3ba tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1362 microversion: 2.1 time: 0.200514 Jul 20 15:37:35.624252 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 337/664] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:35 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:37:36.510916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-b3a82331-a695-40eb-a1a8-f2548c3ec238 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:36.511732 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-b3a82331-a695-40eb-a1a8-f2548c3ec238 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:36.518137 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b3a82331-a695-40eb-a1a8-f2548c3ec238 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:36.518610 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b3a82331-a695-40eb-a1a8-f2548c3ec238 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:36.519356 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b3a82331-a695-40eb-a1a8-f2548c3ec238 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:36.519783 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b3a82331-a695-40eb-a1a8-f2548c3ec238 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:36.639688 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-8a722de6-1de9-4502-a8a9-379076d556d5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:36.640907 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-8a722de6-1de9-4502-a8a9-379076d556d5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:36.647723 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8a722de6-1de9-4502-a8a9-379076d556d5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:36.648181 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8a722de6-1de9-4502-a8a9-379076d556d5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:36.648968 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8a722de6-1de9-4502-a8a9-379076d556d5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:36.649410 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8a722de6-1de9-4502-a8a9-379076d556d5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:36.660757 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-b3a82331-a695-40eb-a1a8-f2548c3ec238 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:36.668997 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-b3a82331-a695-40eb-a1a8-f2548c3ec238 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1506 microversion: 2.1 time: 0.161305 Jul 20 15:37:36.669494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 328/665] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:36 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:37:36.859480 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-8a722de6-1de9-4502-a8a9-379076d556d5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:36.867566 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-8a722de6-1de9-4502-a8a9-379076d556d5 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1362 microversion: 2.1 time: 0.231657 Jul 20 15:37:36.868168 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 338/666] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:36 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:37:37.690212 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-3e7a9c2a-bfef-4a18-9414-9ec8248c72c8 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:37.690964 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-3e7a9c2a-bfef-4a18-9414-9ec8248c72c8 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:37.701692 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3e7a9c2a-bfef-4a18-9414-9ec8248c72c8 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:37.702246 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3e7a9c2a-bfef-4a18-9414-9ec8248c72c8 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:37.703344 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3e7a9c2a-bfef-4a18-9414-9ec8248c72c8 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:37.704073 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3e7a9c2a-bfef-4a18-9414-9ec8248c72c8 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:37.749222 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-82bddb5a-0241-48e3-b68b-74682bc4a521 req-9412b013-fb8e-43ff-b9b0-ef68c14658cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8fe888-a3ab-4889-a5d5-f11697f7c352", "name": "network-vif-deleted", "tag": "4b72a20e-3358-46f1-aef8-ee2cf0cabcd7"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:37:37.758127 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-82bddb5a-0241-48e3-b68b-74682bc4a521 req-9412b013-fb8e-43ff-b9b0-ef68c14658cb service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:37.758525 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-82bddb5a-0241-48e3-b68b-74682bc4a521 req-9412b013-fb8e-43ff-b9b0-ef68c14658cb service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:37.773627 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-82bddb5a-0241-48e3-b68b-74682bc4a521 req-9412b013-fb8e-43ff-b9b0-ef68c14658cb service nova] Creating event network-vif-deleted:4b72a20e-3358-46f1-aef8-ee2cf0cabcd7 for instance 9b8fe888-a3ab-4889-a5d5-f11697f7c352 on hv-cinder-81914 Jul 20 15:37:37.776816 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-82bddb5a-0241-48e3-b68b-74682bc4a521 req-9412b013-fb8e-43ff-b9b0-ef68c14658cb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031947 Jul 20 15:37:37.777455 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 339/667] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:37:37.777820 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-3e7a9c2a-bfef-4a18-9414-9ec8248c72c8 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:37.785516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-3e7a9c2a-bfef-4a18-9414-9ec8248c72c8 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1464 microversion: 2.1 time: 0.102807 Jul 20 15:37:37.786145 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 329/668] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:37 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1464 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:37.884849 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-468a1aa8-5830-4c21-bd98-00922c2f195c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:37.885579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-468a1aa8-5830-4c21-bd98-00922c2f195c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:37.891853 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-468a1aa8-5830-4c21-bd98-00922c2f195c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:37.892377 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-468a1aa8-5830-4c21-bd98-00922c2f195c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:37.893025 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-468a1aa8-5830-4c21-bd98-00922c2f195c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:37.893454 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-468a1aa8-5830-4c21-bd98-00922c2f195c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:38.023789 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-468a1aa8-5830-4c21-bd98-00922c2f195c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:38.031968 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-468a1aa8-5830-4c21-bd98-00922c2f195c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1362 microversion: 2.1 time: 0.151400 Jul 20 15:37:38.032538 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 340/669] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:37 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:38.804662 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-58c21aed-4221-403b-95e7-7637917d6287 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:38.805613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-58c21aed-4221-403b-95e7-7637917d6287 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:38.812735 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-58c21aed-4221-403b-95e7-7637917d6287 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:38.814192 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-58c21aed-4221-403b-95e7-7637917d6287 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:38.814192 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-58c21aed-4221-403b-95e7-7637917d6287 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:38.814485 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-58c21aed-4221-403b-95e7-7637917d6287 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:38.893202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-58c21aed-4221-403b-95e7-7637917d6287 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:38.900852 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-58c21aed-4221-403b-95e7-7637917d6287 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1464 microversion: 2.1 time: 0.101486 Jul 20 15:37:38.905787 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 330/670] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:38 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1464 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:39.048689 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-ceb9e220-1b12-454e-94cc-d952f73a0971 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:39.049252 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-ceb9e220-1b12-454e-94cc-d952f73a0971 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:39.055821 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ceb9e220-1b12-454e-94cc-d952f73a0971 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:39.056273 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ceb9e220-1b12-454e-94cc-d952f73a0971 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:39.057066 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ceb9e220-1b12-454e-94cc-d952f73a0971 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:39.057501 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ceb9e220-1b12-454e-94cc-d952f73a0971 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:39.189361 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-ceb9e220-1b12-454e-94cc-d952f73a0971 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:39.196820 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-ceb9e220-1b12-454e-94cc-d952f73a0971 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1362 microversion: 2.1 time: 0.152119 Jul 20 15:37:39.197423 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 341/671] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:39 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:39.917763 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-da3f00a4-87ae-459e-b932-4de7e8558373 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:39.918414 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-da3f00a4-87ae-459e-b932-4de7e8558373 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:39.924796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-da3f00a4-87ae-459e-b932-4de7e8558373 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:39.925232 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-da3f00a4-87ae-459e-b932-4de7e8558373 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:39.925988 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-da3f00a4-87ae-459e-b932-4de7e8558373 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:39.926446 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-da3f00a4-87ae-459e-b932-4de7e8558373 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:39.987934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-da3f00a4-87ae-459e-b932-4de7e8558373 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:39.995317 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-da3f00a4-87ae-459e-b932-4de7e8558373 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1464 microversion: 2.1 time: 0.081462 Jul 20 15:37:39.995875 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 331/672] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:39 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1464 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:40.221377 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-a5999d6b-e0fb-40e7-84fb-230175aadfe9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:40.221883 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-a5999d6b-e0fb-40e7-84fb-230175aadfe9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:40.228372 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a5999d6b-e0fb-40e7-84fb-230175aadfe9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:40.228810 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a5999d6b-e0fb-40e7-84fb-230175aadfe9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:40.229552 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a5999d6b-e0fb-40e7-84fb-230175aadfe9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:40.229984 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a5999d6b-e0fb-40e7-84fb-230175aadfe9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:40.361173 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-a5999d6b-e0fb-40e7-84fb-230175aadfe9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:40.368625 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-a5999d6b-e0fb-40e7-84fb-230175aadfe9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1362 microversion: 2.1 time: 0.151164 Jul 20 15:37:40.369185 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 342/673] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:40 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:41.014817 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-9a843cd8-b859-4bdb-80b5-09c0d0db863c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:41.015574 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-9a843cd8-b859-4bdb-80b5-09c0d0db863c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:41.023851 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9a843cd8-b859-4bdb-80b5-09c0d0db863c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:41.024599 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9a843cd8-b859-4bdb-80b5-09c0d0db863c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:41.025556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9a843cd8-b859-4bdb-80b5-09c0d0db863c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:41.026125 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9a843cd8-b859-4bdb-80b5-09c0d0db863c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:41.094972 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-9a843cd8-b859-4bdb-80b5-09c0d0db863c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:41.102747 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-9a843cd8-b859-4bdb-80b5-09c0d0db863c tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1292 microversion: 2.1 time: 0.093524 Jul 20 15:37:41.103322 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 332/674] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:41 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1292 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:41.385728 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-69c4bc85-7dc4-4ec5-80f0-258bc9394b66 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:41.387136 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-69c4bc85-7dc4-4ec5-80f0-258bc9394b66 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:41.394379 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-69c4bc85-7dc4-4ec5-80f0-258bc9394b66 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:41.394736 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-69c4bc85-7dc4-4ec5-80f0-258bc9394b66 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:41.395568 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-69c4bc85-7dc4-4ec5-80f0-258bc9394b66 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:41.396002 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-69c4bc85-7dc4-4ec5-80f0-258bc9394b66 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:41.398850 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=100 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:41.541275 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-69c4bc85-7dc4-4ec5-80f0-258bc9394b66 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:41.548711 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-69c4bc85-7dc4-4ec5-80f0-258bc9394b66 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1549 microversion: 2.1 time: 0.167639 Jul 20 15:37:41.549264 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 343/675] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:41 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:41.565396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-50dcf6bb-2d14-4bb8-8ffe-9589a549ed1b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:41.566386 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-50dcf6bb-2d14-4bb8-8ffe-9589a549ed1b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:41.572632 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-50dcf6bb-2d14-4bb8-8ffe-9589a549ed1b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:41.573081 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-50dcf6bb-2d14-4bb8-8ffe-9589a549ed1b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:41.573827 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-50dcf6bb-2d14-4bb8-8ffe-9589a549ed1b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:41.574782 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-50dcf6bb-2d14-4bb8-8ffe-9589a549ed1b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:41.657229 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-50dcf6bb-2d14-4bb8-8ffe-9589a549ed1b tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095121 Jul 20 15:37:41.657229 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 333/676] 10.222.0.78 () {58 vars in 1274 bytes} [Wed Jul 20 15:37:41 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:37:42.118975 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e257db1a-5b2f-416f-bbfa-efe6ca378042 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:42.120201 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e257db1a-5b2f-416f-bbfa-efe6ca378042 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:42.126341 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e257db1a-5b2f-416f-bbfa-efe6ca378042 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:42.126788 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e257db1a-5b2f-416f-bbfa-efe6ca378042 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:42.127543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e257db1a-5b2f-416f-bbfa-efe6ca378042 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:42.127970 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e257db1a-5b2f-416f-bbfa-efe6ca378042 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:42.159860 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e257db1a-5b2f-416f-bbfa-efe6ca378042 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:42.160311 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e257db1a-5b2f-416f-bbfa-efe6ca378042 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:42.160759 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.objects.instance [None req-e257db1a-5b2f-416f-bbfa-efe6ca378042 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lazy-loading 'fault' on Instance uuid 9b8fe888-a3ab-4889-a5d5-f11697f7c352 {{(pid=124712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:37:42.205394 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-e257db1a-5b2f-416f-bbfa-efe6ca378042 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:42.213517 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-e257db1a-5b2f-416f-bbfa-efe6ca378042 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 200 len: 1311 microversion: 2.1 time: 0.098563 Jul 20 15:37:42.214065 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 344/677] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:42 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:42.850620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-68b7f306-b437-4d79-979d-088f26abc41a req-19e92693-f4e1-4c1a-8d29-d80c423b338b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0f28926-7b36-49a2-bd27-7b7006fa992e", "tag": "3aaaffa8-35ca-428a-a369-dca539b96513"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:37:42.860831 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-68b7f306-b437-4d79-979d-088f26abc41a req-19e92693-f4e1-4c1a-8d29-d80c423b338b service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:42.861369 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-68b7f306-b437-4d79-979d-088f26abc41a req-19e92693-f4e1-4c1a-8d29-d80c423b338b service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:42.874715 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-68b7f306-b437-4d79-979d-088f26abc41a req-19e92693-f4e1-4c1a-8d29-d80c423b338b service nova] Creating event network-changed:3aaaffa8-35ca-428a-a369-dca539b96513 for instance a0f28926-7b36-49a2-bd27-7b7006fa992e on hv-cinder-81914 Jul 20 15:37:42.881338 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-68b7f306-b437-4d79-979d-088f26abc41a req-19e92693-f4e1-4c1a-8d29-d80c423b338b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034874 Jul 20 15:37:42.881945 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 334/678] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:37:43.231500 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-a376d7a4-e0e0-4adc-b169-1066309e41bd tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:43.232908 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-a376d7a4-e0e0-4adc-b169-1066309e41bd tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: 9b8fe888-a3ab-4889-a5d5-f11697f7c352] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:43.241605 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a376d7a4-e0e0-4adc-b169-1066309e41bd tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:43.244784 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a376d7a4-e0e0-4adc-b169-1066309e41bd tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:43.244784 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a376d7a4-e0e0-4adc-b169-1066309e41bd tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:43.244784 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a376d7a4-e0e0-4adc-b169-1066309e41bd tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:43.262288 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-a376d7a4-e0e0-4adc-b169-1066309e41bd tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] HTTP exception thrown: Instance 9b8fe888-a3ab-4889-a5d5-f11697f7c352 could not be found. Jul 20 15:37:43.264562 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-a376d7a4-e0e0-4adc-b169-1066309e41bd tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Request method failure captured: Jul 20 15:37:43.264562 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 HTTP/1.1 Jul 20 15:37:43.264562 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:37:43.264562 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:37:43.264562 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:37:43.264562 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:37:43.264562 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:37:43.264562 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:37:43.264562 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:37:43.264562 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:37:43.264562 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2B_nGe2iOCK4tpUXv7QabEEnZaZW6RYPqleka0psoTfCGUPxAgJvaFOHiUD5txfR4A4Hv1RzSFAd2v9PbHR17R2ddNfAKs2jQu_tXTgNRWpbrjgsTUb2vYhREm-bYeMJTibFF78_Vxw9bGxCNNDb--ZMo_XhlRZwYM49r3qyh0pb7pM Jul 20 15:37:43.264562 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:37:43.264562 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:37:43.264562 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:37:43.264562 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:37:43.264562 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:37:43.264562 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:37:43.264562 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 61872ef687074f5791a2cc46732bebdf Jul 20 15:37:43.264562 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1769185307 Jul 20 15:37:43.264562 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:37:43.264562 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:37:43.266100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/61872ef687074f5791a2cc46732bebdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/61872ef687074f5791a2cc46732bebdf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_61872ef687074f5791a2cc46732bebdf", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/61872ef687074f5791a2cc46732bebdf"}]}] Jul 20 15:37:43.266100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1769185307 Jul 20 15:37:43.266100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 61872ef687074f5791a2cc46732bebdf Jul 20 15:37:43.266100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1769185307 Jul 20 15:37:43.266100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-ServerRescueNegativeTestJSON-1769185307-project Jul 20 15:37:43.266100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:37:43.266100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:37:43.266100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: ebbcfe6341a3486d93e12c09f83954dc Jul 20 15:37:43.266100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1769185307-project Jul 20 15:37:43.266100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:37:43.266100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance 9b8fe888-a3ab-4889-a5d5-f11697f7c352 could not be found. Jul 20 15:37:43.266100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': '9b8fe888-a3ab-4889-a5d5-f11697f7c352'} Jul 20 15:37:43.268150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:37:43.268150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:37:43.268150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:37:43.268150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:37:43.268150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:37:43.268150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:37:43.268150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:37:43.268150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:37:43.268150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:37:43.268150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:37:43.268150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b8fe888-a3ab-4889-a5d5-f11697f7c352 could not be found. Jul 20 15:37:43.268150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:37:43.268150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:37:43.268150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:37:43.268150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:37:43.268150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:37:43.268150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:37:43.268150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:37:43.268150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:37:43.268150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:37:43.269687 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:37:43.269687 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:37:43.269687 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:37:43.269687 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:37:43.269687 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:37:43.269687 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:37:43.269687 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:37:43.269687 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b8fe888-a3ab-4889-a5d5-f11697f7c352 could not be found. Jul 20 15:37:43.269687 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:37:43.269687 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:37:43.269687 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:37:43.269687 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:37:43.269687 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:37:43.269687 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:37:43.269687 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:37:43.269687 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:37:43.269687 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b8fe888-a3ab-4889-a5d5-f11697f7c352 could not be found. Jul 20 15:37:43.269687 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:37:43.272059 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-a376d7a4-e0e0-4adc-b169-1066309e41bd tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Returning 404 to user: Instance 9b8fe888-a3ab-4889-a5d5-f11697f7c352 could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:37:43.273530 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-a376d7a4-e0e0-4adc-b169-1066309e41bd tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352" status: 404 len: 111 microversion: 2.1 time: 0.046076 Jul 20 15:37:43.274307 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 345/679] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:43 2022] GET /compute/v2.1/servers/9b8fe888-a3ab-4889-a5d5-f11697f7c352 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:37:43.287076 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ad2efb85-2a01-4f02-b7f5-c43cbd4a9183 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:43.288088 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ad2efb85-2a01-4f02-b7f5-c43cbd4a9183 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:43.296013 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ad2efb85-2a01-4f02-b7f5-c43cbd4a9183 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:43.297054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ad2efb85-2a01-4f02-b7f5-c43cbd4a9183 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:43.298525 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ad2efb85-2a01-4f02-b7f5-c43cbd4a9183 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:43.299179 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ad2efb85-2a01-4f02-b7f5-c43cbd4a9183 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:43.340921 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ad2efb85-2a01-4f02-b7f5-c43cbd4a9183 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Going to try to terminate instance {{(pid=124711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 15:37:43.358732 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:43.649675 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-ad2efb85-2a01-4f02-b7f5-c43cbd4a9183 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 204 len: 0 microversion: 2.1 time: 0.369051 Jul 20 15:37:43.650391 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 335/680] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:37:43 2022] DELETE /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 15:37:43.659687 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-383c04b0-951a-46b0-bed2-059a52b65021 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:43.660285 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-383c04b0-951a-46b0-bed2-059a52b65021 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:43.666738 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-383c04b0-951a-46b0-bed2-059a52b65021 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:43.667583 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-383c04b0-951a-46b0-bed2-059a52b65021 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:43.669026 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-383c04b0-951a-46b0-bed2-059a52b65021 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:43.669465 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-383c04b0-951a-46b0-bed2-059a52b65021 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:43.818007 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-383c04b0-951a-46b0-bed2-059a52b65021 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:43.826145 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-383c04b0-951a-46b0-bed2-059a52b65021 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1520 microversion: 2.1 time: 0.171396 Jul 20 15:37:43.826829 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 346/681] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:43 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:44.844692 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-72704ab4-05da-4e67-877e-f4e6bd5ecb82 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:44.845409 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-72704ab4-05da-4e67-877e-f4e6bd5ecb82 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:44.851963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-72704ab4-05da-4e67-877e-f4e6bd5ecb82 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:44.852408 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-72704ab4-05da-4e67-877e-f4e6bd5ecb82 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:44.853166 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-72704ab4-05da-4e67-877e-f4e6bd5ecb82 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:44.853599 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-72704ab4-05da-4e67-877e-f4e6bd5ecb82 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:44.987014 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-72704ab4-05da-4e67-877e-f4e6bd5ecb82 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:44.994688 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-72704ab4-05da-4e67-877e-f4e6bd5ecb82 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1520 microversion: 2.1 time: 0.154289 Jul 20 15:37:44.995252 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 336/682] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:44 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:45.168225 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-a8497dfa-45bf-42e0-b44a-a84f70e63249 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:45.168795 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-a8497dfa-45bf-42e0-b44a-a84f70e63249 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:45.175569 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a8497dfa-45bf-42e0-b44a-a84f70e63249 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:45.176011 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a8497dfa-45bf-42e0-b44a-a84f70e63249 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:45.176770 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a8497dfa-45bf-42e0-b44a-a84f70e63249 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:45.177195 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a8497dfa-45bf-42e0-b44a-a84f70e63249 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:45.256619 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.objects.instance [None req-a8497dfa-45bf-42e0-b44a-a84f70e63249 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lazy-loading 'services' on Instance uuid c6d19002-eab6-4af7-b0bc-65bf247b3823 {{(pid=124712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:37:45.456174 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-a8497dfa-45bf-42e0-b44a-a84f70e63249 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823/os-volume_attachments/b15efca7-0b98-4d90-a451-0b6f2b07ceac" status: 202 len: 0 microversion: 2.1 time: 0.291648 Jul 20 15:37:45.456766 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 347/683] 10.222.0.78 () {58 vars in 1415 bytes} [Wed Jul 20 15:37:45 2022] DELETE /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823/os-volume_attachments/b15efca7-0b98-4d90-a451-0b6f2b07ceac => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:37:46.012071 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-2e588b94-8f44-4aa9-9f5f-4d66df5cbf9f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:46.012678 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-2e588b94-8f44-4aa9-9f5f-4d66df5cbf9f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:46.021029 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2e588b94-8f44-4aa9-9f5f-4d66df5cbf9f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:46.021841 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2e588b94-8f44-4aa9-9f5f-4d66df5cbf9f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:46.022665 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2e588b94-8f44-4aa9-9f5f-4d66df5cbf9f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:46.023108 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2e588b94-8f44-4aa9-9f5f-4d66df5cbf9f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:46.156876 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2e588b94-8f44-4aa9-9f5f-4d66df5cbf9f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:46.164227 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-2e588b94-8f44-4aa9-9f5f-4d66df5cbf9f tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1520 microversion: 2.1 time: 0.156074 Jul 20 15:37:46.164783 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 337/684] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:46 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:47.181920 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-fae1d355-4a4e-48f1-8ebc-854dfb201221 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:47.182791 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-fae1d355-4a4e-48f1-8ebc-854dfb201221 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:47.189668 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fae1d355-4a4e-48f1-8ebc-854dfb201221 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:47.190108 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fae1d355-4a4e-48f1-8ebc-854dfb201221 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:47.190889 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fae1d355-4a4e-48f1-8ebc-854dfb201221 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:47.191318 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fae1d355-4a4e-48f1-8ebc-854dfb201221 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:47.411064 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-fae1d355-4a4e-48f1-8ebc-854dfb201221 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:47.419168 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-fae1d355-4a4e-48f1-8ebc-854dfb201221 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1520 microversion: 2.1 time: 0.241954 Jul 20 15:37:47.419776 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 348/685] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:47 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:47.884682 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-d9eab230-6453-4100-9d61-4bffdb4636e5 req-c213cf49-4e29-497c-b06d-910fb03c4efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0e200ad-ac34-4618-9518-9cc89ec380de", "name": "network-vif-deleted", "tag": "b9a62c66-1f34-4d8d-8dcb-53ae32a72875"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:37:47.894205 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-d9eab230-6453-4100-9d61-4bffdb4636e5 req-c213cf49-4e29-497c-b06d-910fb03c4efa service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:47.894855 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-d9eab230-6453-4100-9d61-4bffdb4636e5 req-c213cf49-4e29-497c-b06d-910fb03c4efa service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:47.906168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-d9eab230-6453-4100-9d61-4bffdb4636e5 req-c213cf49-4e29-497c-b06d-910fb03c4efa service nova] Creating event network-vif-deleted:b9a62c66-1f34-4d8d-8dcb-53ae32a72875 for instance e0e200ad-ac34-4618-9518-9cc89ec380de on hv-cinder-81914 Jul 20 15:37:47.911536 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-d9eab230-6453-4100-9d61-4bffdb4636e5 req-c213cf49-4e29-497c-b06d-910fb03c4efa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030709 Jul 20 15:37:47.912125 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 338/686] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:37:48.436743 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-7dfc93b6-2a26-4d0e-ba3b-be1bd7b76d96 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:48.437301 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-7dfc93b6-2a26-4d0e-ba3b-be1bd7b76d96 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:48.444636 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7dfc93b6-2a26-4d0e-ba3b-be1bd7b76d96 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:48.445076 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7dfc93b6-2a26-4d0e-ba3b-be1bd7b76d96 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:48.446029 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7dfc93b6-2a26-4d0e-ba3b-be1bd7b76d96 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:48.446493 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7dfc93b6-2a26-4d0e-ba3b-be1bd7b76d96 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:48.478472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7dfc93b6-2a26-4d0e-ba3b-be1bd7b76d96 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:48.478923 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7dfc93b6-2a26-4d0e-ba3b-be1bd7b76d96 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:48.479358 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.objects.instance [None req-7dfc93b6-2a26-4d0e-ba3b-be1bd7b76d96 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lazy-loading 'fault' on Instance uuid e0e200ad-ac34-4618-9518-9cc89ec380de {{(pid=124712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:37:48.527835 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-7dfc93b6-2a26-4d0e-ba3b-be1bd7b76d96 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebbcfe6341a3486d93e12c09f83954dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61872ef687074f5791a2cc46732bebdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:48.535737 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-7dfc93b6-2a26-4d0e-ba3b-be1bd7b76d96 tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 200 len: 1311 microversion: 2.1 time: 0.103539 Jul 20 15:37:48.536306 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 349/687] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:48 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:48.684401 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c9be2bce-e669-4286-9d01-ad549bfa78c7 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:48.685046 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c9be2bce-e669-4286-9d01-ad549bfa78c7 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:48.687206 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:48.693588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c9be2bce-e669-4286-9d01-ad549bfa78c7 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:48.694060 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c9be2bce-e669-4286-9d01-ad549bfa78c7 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:48.694919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c9be2bce-e669-4286-9d01-ad549bfa78c7 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:48.695386 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c9be2bce-e669-4286-9d01-ad549bfa78c7 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:48.724747 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c9be2bce-e669-4286-9d01-ad549bfa78c7 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] Going to try to terminate instance {{(pid=124711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 15:37:49.012276 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c9be2bce-e669-4286-9d01-ad549bfa78c7 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823" status: 204 len: 0 microversion: 2.1 time: 0.331511 Jul 20 15:37:49.012986 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 339/688] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:37:48 2022] DELETE /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 15:37:49.021071 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-6a09589e-b082-4fbd-bccb-d720020cdab8 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:49.021677 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-6a09589e-b082-4fbd-bccb-d720020cdab8 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:49.028343 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6a09589e-b082-4fbd-bccb-d720020cdab8 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:49.028881 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6a09589e-b082-4fbd-bccb-d720020cdab8 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:49.029648 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6a09589e-b082-4fbd-bccb-d720020cdab8 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:49.030074 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6a09589e-b082-4fbd-bccb-d720020cdab8 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:49.164693 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-6a09589e-b082-4fbd-bccb-d720020cdab8 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:49.172204 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-6a09589e-b082-4fbd-bccb-d720020cdab8 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823" status: 200 len: 1514 microversion: 2.1 time: 0.154988 Jul 20 15:37:49.172761 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 350/689] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:49 2022] GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:49.553501 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d74eec3b-4754-4e6f-9743-d25f6384ea4b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:49.554215 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-d74eec3b-4754-4e6f-9743-d25f6384ea4b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] [instance: e0e200ad-ac34-4618-9518-9cc89ec380de] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:49.560800 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d74eec3b-4754-4e6f-9743-d25f6384ea4b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:49.561241 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d74eec3b-4754-4e6f-9743-d25f6384ea4b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:49.562025 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d74eec3b-4754-4e6f-9743-d25f6384ea4b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:49.562487 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d74eec3b-4754-4e6f-9743-d25f6384ea4b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:49.576753 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-d74eec3b-4754-4e6f-9743-d25f6384ea4b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] HTTP exception thrown: Instance e0e200ad-ac34-4618-9518-9cc89ec380de could not be found. Jul 20 15:37:49.578424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d74eec3b-4754-4e6f-9743-d25f6384ea4b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Request method failure captured: Jul 20 15:37:49.578424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de HTTP/1.1 Jul 20 15:37:49.578424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:37:49.578424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:37:49.578424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:37:49.578424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:37:49.578424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:37:49.578424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:37:49.578424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:37:49.578424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:37:49.578424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2B_nGe2iOCK4tpUXv7QabEEnZaZW6RYPqleka0psoTfCGUPxAgJvaFOHiUD5txfR4A4Hv1RzSFAd2v9PbHR17R2ddNfAKs2jQu_tXTgNRWpbrjgsTUb2vYhREm-bYeMJTibFF78_Vxw9bGxCNNDb--ZMo_XhlRZwYM49r3qyh0pb7pM Jul 20 15:37:49.578424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:37:49.578424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:37:49.578424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:37:49.578424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:37:49.578424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:37:49.578424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:37:49.578424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: 61872ef687074f5791a2cc46732bebdf Jul 20 15:37:49.578424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1769185307 Jul 20 15:37:49.578424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:37:49.578424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:37:49.580058 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/61872ef687074f5791a2cc46732bebdf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/61872ef687074f5791a2cc46732bebdf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_61872ef687074f5791a2cc46732bebdf", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/61872ef687074f5791a2cc46732bebdf"}]}] Jul 20 15:37:49.580058 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1769185307 Jul 20 15:37:49.580058 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: 61872ef687074f5791a2cc46732bebdf Jul 20 15:37:49.580058 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1769185307 Jul 20 15:37:49.580058 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-ServerRescueNegativeTestJSON-1769185307-project Jul 20 15:37:49.580058 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:37:49.580058 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:37:49.580058 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: ebbcfe6341a3486d93e12c09f83954dc Jul 20 15:37:49.580058 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1769185307-project Jul 20 15:37:49.580058 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: > Jul 20 15:37:49.580058 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Instance e0e200ad-ac34-4618-9518-9cc89ec380de could not be found. Jul 20 15:37:49.580058 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': 'e0e200ad-ac34-4618-9518-9cc89ec380de'} Jul 20 15:37:49.580934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:37:49.580934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:37:49.580934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:37:49.580934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:37:49.580934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:37:49.580934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:37:49.580934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:37:49.580934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:37:49.580934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:37:49.580934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:37:49.580934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0e200ad-ac34-4618-9518-9cc89ec380de could not be found. Jul 20 15:37:49.580934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:37:49.580934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:37:49.580934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:37:49.580934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:37:49.580934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:37:49.580934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:37:49.580934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:37:49.580934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:37:49.580934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:37:49.582436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:37:49.582436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:37:49.582436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:37:49.582436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:37:49.582436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:37:49.582436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:37:49.582436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:37:49.582436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0e200ad-ac34-4618-9518-9cc89ec380de could not be found. Jul 20 15:37:49.582436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:37:49.582436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:37:49.582436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:37:49.582436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:37:49.582436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:37:49.582436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:37:49.582436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:37:49.582436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:37:49.582436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0e200ad-ac34-4618-9518-9cc89ec380de could not be found. Jul 20 15:37:49.582436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:37:49.584250 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d74eec3b-4754-4e6f-9743-d25f6384ea4b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] Returning 404 to user: Instance e0e200ad-ac34-4618-9518-9cc89ec380de could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:37:49.584250 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d74eec3b-4754-4e6f-9743-d25f6384ea4b tempest-ServerRescueNegativeTestJSON-1769185307 tempest-ServerRescueNegativeTestJSON-1769185307-project] 10.222.0.78 "GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de" status: 404 len: 111 microversion: 2.1 time: 0.030532 Jul 20 15:37:49.584250 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 340/690] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:49 2022] GET /compute/v2.1/servers/e0e200ad-ac34-4618-9518-9cc89ec380de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:37:50.188946 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-70853990-8358-4d5a-94bb-9aa6415a884c tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:50.189466 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-70853990-8358-4d5a-94bb-9aa6415a884c tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:50.195969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-70853990-8358-4d5a-94bb-9aa6415a884c tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:50.196408 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-70853990-8358-4d5a-94bb-9aa6415a884c tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:50.197159 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-70853990-8358-4d5a-94bb-9aa6415a884c tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:50.197592 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-70853990-8358-4d5a-94bb-9aa6415a884c tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:50.429478 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-70853990-8358-4d5a-94bb-9aa6415a884c tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:50.437042 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-70853990-8358-4d5a-94bb-9aa6415a884c tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823" status: 200 len: 1514 microversion: 2.1 time: 0.251932 Jul 20 15:37:50.437608 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 351/691] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:50 2022] GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823 => generated 1514 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:51.454789 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-2e1f0a02-5ec1-42fc-b450-43ee10e2261e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:51.455565 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-2e1f0a02-5ec1-42fc-b450-43ee10e2261e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:51.462810 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2e1f0a02-5ec1-42fc-b450-43ee10e2261e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:51.463275 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2e1f0a02-5ec1-42fc-b450-43ee10e2261e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:51.464076 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2e1f0a02-5ec1-42fc-b450-43ee10e2261e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:51.464568 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2e1f0a02-5ec1-42fc-b450-43ee10e2261e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:51.787572 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2e1f0a02-5ec1-42fc-b450-43ee10e2261e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:51.796071 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-2e1f0a02-5ec1-42fc-b450-43ee10e2261e tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823" status: 200 len: 1514 microversion: 2.1 time: 0.345335 Jul 20 15:37:51.796651 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 341/692] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:51 2022] GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823 => generated 1514 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:52.223119 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-b39d5f92-a7d5-4d12-9acc-ec80051e2175 req-47daf131-0e2e-432a-a2f8-faf933596803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6d19002-eab6-4af7-b0bc-65bf247b3823", "name": "network-vif-deleted", "tag": "4d6584c0-9719-4f3c-9c31-bd0bd3f2bb1a"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:37:52.234855 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-b39d5f92-a7d5-4d12-9acc-ec80051e2175 req-47daf131-0e2e-432a-a2f8-faf933596803 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:52.235488 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-b39d5f92-a7d5-4d12-9acc-ec80051e2175 req-47daf131-0e2e-432a-a2f8-faf933596803 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:52.249515 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-b39d5f92-a7d5-4d12-9acc-ec80051e2175 req-47daf131-0e2e-432a-a2f8-faf933596803 service nova] Creating event network-vif-deleted:4d6584c0-9719-4f3c-9c31-bd0bd3f2bb1a for instance c6d19002-eab6-4af7-b0bc-65bf247b3823 on hv-cinder-81914 Jul 20 15:37:52.255398 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-b39d5f92-a7d5-4d12-9acc-ec80051e2175 req-47daf131-0e2e-432a-a2f8-faf933596803 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038918 Jul 20 15:37:52.256010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 352/693] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:37:52.835751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-add54c38-cf96-4c3d-b3cd-daec572db392 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:52.835751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-add54c38-cf96-4c3d-b3cd-daec572db392 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:52.836640 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-add54c38-cf96-4c3d-b3cd-daec572db392 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:52.837270 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-add54c38-cf96-4c3d-b3cd-daec572db392 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:52.838463 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-add54c38-cf96-4c3d-b3cd-daec572db392 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:52.839081 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-add54c38-cf96-4c3d-b3cd-daec572db392 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:52.883531 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-add54c38-cf96-4c3d-b3cd-daec572db392 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:52.884281 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-add54c38-cf96-4c3d-b3cd-daec572db392 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:52.885291 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.objects.instance [None req-add54c38-cf96-4c3d-b3cd-daec572db392 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lazy-loading 'fault' on Instance uuid c6d19002-eab6-4af7-b0bc-65bf247b3823 {{(pid=124711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:37:52.942712 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-add54c38-cf96-4c3d-b3cd-daec572db392 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea2abd1398f4fba93b3b7a5beb52ba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e3b499bb69b4b449a2e2515d94094fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:37:52.952084 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-add54c38-cf96-4c3d-b3cd-daec572db392 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823" status: 200 len: 1309 microversion: 2.1 time: 0.141403 Jul 20 15:37:52.952722 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 342/694] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:52 2022] GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823 => generated 1309 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:37:53.981891 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-6c7cdc34-b8fa-453c-8aaf-4080378c1802 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:37:53.992303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-6c7cdc34-b8fa-453c-8aaf-4080378c1802 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] [instance: c6d19002-eab6-4af7-b0bc-65bf247b3823] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:37:54.003443 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:37:54.013940 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6c7cdc34-b8fa-453c-8aaf-4080378c1802 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:54.015111 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6c7cdc34-b8fa-453c-8aaf-4080378c1802 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:54.016747 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6c7cdc34-b8fa-453c-8aaf-4080378c1802 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:37:54.018132 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6c7cdc34-b8fa-453c-8aaf-4080378c1802 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:37:54.055320 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-6c7cdc34-b8fa-453c-8aaf-4080378c1802 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] HTTP exception thrown: Instance c6d19002-eab6-4af7-b0bc-65bf247b3823 could not be found. Jul 20 15:37:54.055320 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-6c7cdc34-b8fa-453c-8aaf-4080378c1802 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Request method failure captured: Jul 20 15:37:54.055320 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823 HTTP/1.1 Jul 20 15:37:54.055320 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:37:54.055320 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:37:54.055320 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:37:54.055320 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:37:54.055320 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:37:54.055320 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:37:54.055320 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:37:54.055320 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:37:54.055320 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2CC-6bl2h8BuqiXXXl0RaTNVuWc7LSRZZzXC416pMusaF1ou9I1ajDDYyW4TV7G0mi0SqaRGIjMy5HCU0Cjk9_fEMwbfHxtoeURXI_3k9HClo6swy_rGHL6f7p-Rwwb68I6aHENNuN79olu5GqY8qzJaruZJGC-0UaZIviRY4q-fyoM Jul 20 15:37:54.055320 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:37:54.055320 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:37:54.055320 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:37:54.055320 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:37:54.055320 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:37:54.055320 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:37:54.055320 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 3e3b499bb69b4b449a2e2515d94094fb Jul 20 15:37:54.055320 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1089502414 Jul 20 15:37:54.055320 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:37:54.055320 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:37:54.056829 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3e3b499bb69b4b449a2e2515d94094fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3e3b499bb69b4b449a2e2515d94094fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3e3b499bb69b4b449a2e2515d94094fb", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3e3b499bb69b4b449a2e2515d94094fb"}]}] Jul 20 15:37:54.056829 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-VolumesSnapshotTestJSON-1089502414 Jul 20 15:37:54.056829 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 3e3b499bb69b4b449a2e2515d94094fb Jul 20 15:37:54.056829 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1089502414 Jul 20 15:37:54.056829 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-VolumesSnapshotTestJSON-1089502414-project Jul 20 15:37:54.056829 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:37:54.056829 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:37:54.056829 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: 9ea2abd1398f4fba93b3b7a5beb52ba0 Jul 20 15:37:54.056829 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-VolumesSnapshotTestJSON-1089502414-project Jul 20 15:37:54.056829 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:37:54.056829 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance c6d19002-eab6-4af7-b0bc-65bf247b3823 could not be found. Jul 20 15:37:54.056829 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': 'c6d19002-eab6-4af7-b0bc-65bf247b3823'} Jul 20 15:37:54.057603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:37:54.057603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:37:54.057603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:37:54.057603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:37:54.057603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:37:54.057603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:37:54.057603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:37:54.057603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:37:54.057603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:37:54.057603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:37:54.057603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6d19002-eab6-4af7-b0bc-65bf247b3823 could not be found. Jul 20 15:37:54.057603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:37:54.057603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:37:54.057603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:37:54.057603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:37:54.057603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:37:54.057603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:37:54.057603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:37:54.057603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:37:54.057603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:37:54.060280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:37:54.060280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:37:54.060280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:37:54.060280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:37:54.060280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:37:54.060280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:37:54.060280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:37:54.060280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6d19002-eab6-4af7-b0bc-65bf247b3823 could not be found. Jul 20 15:37:54.060280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:37:54.060280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:37:54.060280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:37:54.060280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:37:54.060280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:37:54.060280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:37:54.060280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:37:54.060280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:37:54.060280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6d19002-eab6-4af7-b0bc-65bf247b3823 could not be found. Jul 20 15:37:54.060280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:37:54.062173 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-6c7cdc34-b8fa-453c-8aaf-4080378c1802 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] Returning 404 to user: Instance c6d19002-eab6-4af7-b0bc-65bf247b3823 could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:37:54.062173 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-6c7cdc34-b8fa-453c-8aaf-4080378c1802 tempest-VolumesSnapshotTestJSON-1089502414 tempest-VolumesSnapshotTestJSON-1089502414-project] 10.222.0.78 "GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823" status: 404 len: 111 microversion: 2.1 time: 0.087896 Jul 20 15:37:54.062173 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 353/695] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:37:53 2022] GET /compute/v2.1/servers/c6d19002-eab6-4af7-b0bc-65bf247b3823 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:38:01.275870 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-84c09f9f-3cdf-4b86-b1b8-90b25e447a62 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-883221412"}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:38:01.276985 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-84c09f9f-3cdf-4b86-b1b8-90b25e447a62 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:01.284303 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-84c09f9f-3cdf-4b86-b1b8-90b25e447a62 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:01.284751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-84c09f9f-3cdf-4b86-b1b8-90b25e447a62 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:01.285513 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-84c09f9f-3cdf-4b86-b1b8-90b25e447a62 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:01.285972 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-84c09f9f-3cdf-4b86-b1b8-90b25e447a62 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:01.521783 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.network.security_group_api [None req-84c09f9f-3cdf-4b86-b1b8-90b25e447a62 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Removing security group e2873b3f-98e3-41cd-af50-5b59a2a2aa96 from port 3f4230e5-b6b6-43aa-985b-67a345eed1aa Jul 20 15:38:02.540406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-84c09f9f-3cdf-4b86-b1b8-90b25e447a62 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "POST /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257/action" status: 202 len: 0 microversion: 2.1 time: 1.268396 Jul 20 15:38:02.541817 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 343/696] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Jul 20 15:38:01 2022] POST /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257/action => generated 0 bytes in 1271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:38:02.563738 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-a2277501-d7ac-41f6-81f5-16944fb252d0 req-5af7eb64-dd26-4b26-8f74-02d8f5bcf1de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "170181c4-a3e8-494d-bef6-2048dd9b0257", "tag": "3f4230e5-b6b6-43aa-985b-67a345eed1aa"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:38:02.599265 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-a2277501-d7ac-41f6-81f5-16944fb252d0 req-5af7eb64-dd26-4b26-8f74-02d8f5bcf1de service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:02.603953 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-a2277501-d7ac-41f6-81f5-16944fb252d0 req-5af7eb64-dd26-4b26-8f74-02d8f5bcf1de service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:02.628481 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-a2277501-d7ac-41f6-81f5-16944fb252d0 req-5af7eb64-dd26-4b26-8f74-02d8f5bcf1de service nova] Creating event network-changed:3f4230e5-b6b6-43aa-985b-67a345eed1aa for instance 170181c4-a3e8-494d-bef6-2048dd9b0257 on hv-cinder-81914 Jul 20 15:38:02.639051 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-a2277501-d7ac-41f6-81f5-16944fb252d0 req-5af7eb64-dd26-4b26-8f74-02d8f5bcf1de service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091573 Jul 20 15:38:02.646029 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 354/697] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:38:03.936741 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c7b048bd-59f7-481a-aac2-ffafca269223 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Action: 'create', calling method: .version_select at 0x7efd90a3b160>, body: {"keypair": {"name": "tempest-keypair-240788742", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJ3lIsyk5pt1luVleycvpvb8wpL1LxdbQ6kAPs+2VrWdA5WBpAAPsqQIflZ/JtRjKY4GkEdrF+ZvT0cMQd9oHuXFUv7/hhvW9kNaQx0FC/JnjGQ7W2Pf4zPdWzRXGxOpg=="}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:38:03.954929 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-c7b048bd-59f7-481a-aac2-ffafca269223 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Getting quotas for project 44dc2a5c754d42d1862b331afef2183f. Resources: {'key_pairs'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:38:03.959280 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-c7b048bd-59f7-481a-aac2-ffafca269223 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Getting quotas for user 0235b8fe92554131ba30e1d18f0f2d86 and project 44dc2a5c754d42d1862b331afef2183f. Resources: {'key_pairs'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:38:04.073855 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c7b048bd-59f7-481a-aac2-ffafca269223 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.265305 Jul 20 15:38:04.074498 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 344/698] 10.222.0.78 () {60 vars in 1158 bytes} [Wed Jul 20 15:38:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:38:04.974838 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-60fd4b9e-061b-4cce-82f8-25c85b61d6a5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:04.975520 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-60fd4b9e-061b-4cce-82f8-25c85b61d6a5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:05.003385 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-60fd4b9e-061b-4cce-82f8-25c85b61d6a5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:05.008724 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-60fd4b9e-061b-4cce-82f8-25c85b61d6a5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:05.013980 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-60fd4b9e-061b-4cce-82f8-25c85b61d6a5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:05.014629 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-60fd4b9e-061b-4cce-82f8-25c85b61d6a5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:05.021890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-4b1c274a-5877-45da-a6ac-0926da004dd4 req-d14f77a5-36f0-41f8-a15d-6cf85d90eb01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "170181c4-a3e8-494d-bef6-2048dd9b0257", "tag": "3f4230e5-b6b6-43aa-985b-67a345eed1aa"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:38:05.053998 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-4b1c274a-5877-45da-a6ac-0926da004dd4 req-d14f77a5-36f0-41f8-a15d-6cf85d90eb01 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:05.054618 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-4b1c274a-5877-45da-a6ac-0926da004dd4 req-d14f77a5-36f0-41f8-a15d-6cf85d90eb01 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:05.084228 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-4b1c274a-5877-45da-a6ac-0926da004dd4 req-d14f77a5-36f0-41f8-a15d-6cf85d90eb01 service nova] Creating event network-changed:3f4230e5-b6b6-43aa-985b-67a345eed1aa for instance 170181c4-a3e8-494d-bef6-2048dd9b0257 on hv-cinder-81914 Jul 20 15:38:05.091455 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-4b1c274a-5877-45da-a6ac-0926da004dd4 req-d14f77a5-36f0-41f8-a15d-6cf85d90eb01 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073194 Jul 20 15:38:05.095620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 345/699] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:38:05.193616 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.objects.instance [None req-60fd4b9e-061b-4cce-82f8-25c85b61d6a5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lazy-loading 'services' on Instance uuid 170181c4-a3e8-494d-bef6-2048dd9b0257 {{(pid=124712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:38:05.621485 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-60fd4b9e-061b-4cce-82f8-25c85b61d6a5 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "DELETE /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257/os-volume_attachments/356963b2-cfc2-4f89-82c5-dc487d359a19" status: 202 len: 0 microversion: 2.1 time: 0.649921 Jul 20 15:38:05.622767 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 355/700] 10.222.0.78 () {58 vars in 1415 bytes} [Wed Jul 20 15:38:04 2022] DELETE /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257/os-volume_attachments/356963b2-cfc2-4f89-82c5-dc487d359a19 => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:38:05.661535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e183e15f-4aae-4df1-a785-4458d7c1f58a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:05.661535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e183e15f-4aae-4df1-a785-4458d7c1f58a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:05.678052 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e183e15f-4aae-4df1-a785-4458d7c1f58a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:05.679034 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e183e15f-4aae-4df1-a785-4458d7c1f58a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:05.680108 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e183e15f-4aae-4df1-a785-4458d7c1f58a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:05.680800 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e183e15f-4aae-4df1-a785-4458d7c1f58a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:05.721428 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e183e15f-4aae-4df1-a785-4458d7c1f58a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084517 Jul 20 15:38:05.722797 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 346/701] 10.222.0.78 () {58 vars in 1301 bytes} [Wed Jul 20 15:38:05 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:38:06.745767 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-bdca293a-1efb-4042-9696-b3e22f3540b0 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:06.745767 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-bdca293a-1efb-4042-9696-b3e22f3540b0 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:06.752375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bdca293a-1efb-4042-9696-b3e22f3540b0 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:06.752907 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bdca293a-1efb-4042-9696-b3e22f3540b0 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:06.758737 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bdca293a-1efb-4042-9696-b3e22f3540b0 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:06.758737 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bdca293a-1efb-4042-9696-b3e22f3540b0 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:06.792817 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-bdca293a-1efb-4042-9696-b3e22f3540b0 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062449 Jul 20 15:38:06.794629 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 356/702] 10.222.0.78 () {58 vars in 1301 bytes} [Wed Jul 20 15:38:06 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:38:07.712341 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-3b2b273d-bef1-4bba-8ae2-6ea663e0349f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1503391830", "imageRef": "80914b1c-623c-42a8-810e-836b2cce0d3b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c0af21f-0efa-47e6-8a0b-19b7c3e7c8bc"}], "security_groups": [{"name": "tempest-securitygroup--1910231107"}], "key_name": "tempest-keypair-240788742", "user_data": "}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:38:07.804554 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-aedb1367-98c6-46fd-8755-e1831c9ad3a0 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:07.805486 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-aedb1367-98c6-46fd-8755-e1831c9ad3a0 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:07.812765 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-aedb1367-98c6-46fd-8755-e1831c9ad3a0 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:07.813214 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-aedb1367-98c6-46fd-8755-e1831c9ad3a0 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:07.814006 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-aedb1367-98c6-46fd-8755-e1831c9ad3a0 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:07.814478 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-aedb1367-98c6-46fd-8755-e1831c9ad3a0 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:07.817979 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.network.neutron [None req-3b2b273d-bef1-4bba-8ae2-6ea663e0349f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] validate_networks() for [('4c0af21f-0efa-47e6-8a0b-19b7c3e7c8bc', None, None, None, None, None)] {{(pid=124711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 15:38:07.844032 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-aedb1367-98c6-46fd-8755-e1831c9ad3a0 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043823 Jul 20 15:38:07.844865 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 357/703] 10.222.0.78 () {58 vars in 1301 bytes} [Wed Jul 20 15:38:07 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 15:38:07.855006 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-ec967434-549e-4fa5-8b25-5b9f24e245c1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:07.855739 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-ec967434-549e-4fa5-8b25-5b9f24e245c1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:07.862032 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ec967434-549e-4fa5-8b25-5b9f24e245c1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:07.862513 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ec967434-549e-4fa5-8b25-5b9f24e245c1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:07.863278 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ec967434-549e-4fa5-8b25-5b9f24e245c1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:07.863711 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ec967434-549e-4fa5-8b25-5b9f24e245c1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:07.945522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-ec967434-549e-4fa5-8b25-5b9f24e245c1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] HTTP exception thrown: Instance 170181c4-a3e8-494d-bef6-2048dd9b0257 is not attached to volume 356963b2-cfc2-4f89-82c5-dc487d359a19 Jul 20 15:38:07.948335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-ec967434-549e-4fa5-8b25-5b9f24e245c1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Request method failure captured: Jul 20 15:38:07.948335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: DELETE /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257/os-volume_attachments/356963b2-cfc2-4f89-82c5-dc487d359a19 HTTP/1.1 Jul 20 15:38:07.948335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:38:07.948335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:38:07.948335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:38:07.948335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:38:07.948335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:38:07.948335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:38:07.948335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:38:07.948335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:38:07.948335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2CB9X7ERZYoaDsAKKr0j8gNo88j5JFlxa2cYxMhOU-KeDrZzyGsK9aOpTFbXNCGWEkN2bD4AFGmUQlchfUUM8cuHNoTuElAogJgaj_430pZSP9SEPTxYbTOmIqownARAzZ4JEbezKQwblXpIiVWYp4KYYNJ5vT3tx0JSI97wCkTW77M Jul 20 15:38:07.948335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:38:07.948335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:38:07.948335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:38:07.948335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:38:07.948335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:38:07.948335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:38:07.948335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 8793a880033e400d89ac8de5a30003b7 Jul 20 15:38:07.948335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-TestMinimumBasicScenario-150647912 Jul 20 15:38:07.948335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:38:07.948335 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:38:07.955475 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8793a880033e400d89ac8de5a30003b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8793a880033e400d89ac8de5a30003b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8793a880033e400d89ac8de5a30003b7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8793a880033e400d89ac8de5a30003b7"}]}] Jul 20 15:38:07.955475 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-TestMinimumBasicScenario-150647912 Jul 20 15:38:07.955475 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 8793a880033e400d89ac8de5a30003b7 Jul 20 15:38:07.955475 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-TestMinimumBasicScenario-150647912 Jul 20 15:38:07.955475 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-TestMinimumBasicScenario-150647912-project Jul 20 15:38:07.955475 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:38:07.955475 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:38:07.955475 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: dce92cce74c84abcbec76358c860535f Jul 20 15:38:07.955475 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-TestMinimumBasicScenario-150647912-project Jul 20 15:38:07.955475 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:38:07.955475 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance 170181c4-a3e8-494d-bef6-2048dd9b0257 is not attached to volume 356963b2-cfc2-4f89-82c5-dc487d359a19 Jul 20 15:38:07.957602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'server_id': '170181c4-a3e8-494d-bef6-2048dd9b0257', 'id': '356963b2-cfc2-4f89-82c5-dc487d359a19'} Jul 20 15:38:07.957602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:38:07.957602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:38:07.957602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 15:38:07.957602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 15:38:07.957602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 15:38:07.957602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 15:38:07.957602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 15:38:07.957602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 15:38:07.957602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 356963b2-cfc2-4f89-82c5-dc487d359a19. Jul 20 15:38:07.957602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:38:07.957602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:38:07.957602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:38:07.957602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:38:07.957602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:38:07.957602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:38:07.957602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:38:07.957602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:38:07.957602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:38:07.960092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:38:07.960092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 15:38:07.960092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 15:38:07.960092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 170181c4-a3e8-494d-bef6-2048dd9b0257 is not attached to volume 356963b2-cfc2-4f89-82c5-dc487d359a19 Jul 20 15:38:07.960092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:38:07.960092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:38:07.960092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:38:07.960092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:38:07.960092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:38:07.960092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:38:07.960092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:38:07.960092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:38:07.960092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 170181c4-a3e8-494d-bef6-2048dd9b0257 is not attached to volume 356963b2-cfc2-4f89-82c5-dc487d359a19 Jul 20 15:38:07.960092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:38:07.960092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-ec967434-549e-4fa5-8b25-5b9f24e245c1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Returning 404 to user: Instance 170181c4-a3e8-494d-bef6-2048dd9b0257 is not attached to volume 356963b2-cfc2-4f89-82c5-dc487d359a19 {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:38:07.962140 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-ec967434-549e-4fa5-8b25-5b9f24e245c1 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "DELETE /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257/os-volume_attachments/356963b2-cfc2-4f89-82c5-dc487d359a19" status: 404 len: 154 microversion: 2.1 time: 0.099192 Jul 20 15:38:07.962140 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 358/704] 10.222.0.78 () {58 vars in 1415 bytes} [Wed Jul 20 15:38:07 2022] DELETE /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257/os-volume_attachments/356963b2-cfc2-4f89-82c5-dc487d359a19 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 15:38:08.222535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-3b2b273d-bef1-4bba-8ae2-6ea663e0349f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Flavor limits 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 15:38:08.222535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-3b2b273d-bef1-4bba-8ae2-6ea663e0349f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Image limits 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 15:38:08.222535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-3b2b273d-bef1-4bba-8ae2-6ea663e0349f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Flavor pref 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 15:38:08.222535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-3b2b273d-bef1-4bba-8ae2-6ea663e0349f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Image pref 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 15:38:08.222535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-3b2b273d-bef1-4bba-8ae2-6ea663e0349f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 15:38:08.231747 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3b2b273d-bef1-4bba-8ae2-6ea663e0349f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:08.232257 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3b2b273d-bef1-4bba-8ae2-6ea663e0349f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:08.233157 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3b2b273d-bef1-4bba-8ae2-6ea663e0349f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:08.233582 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3b2b273d-bef1-4bba-8ae2-6ea663e0349f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:08.250172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-3b2b273d-bef1-4bba-8ae2-6ea663e0349f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Getting quotas for project 44dc2a5c754d42d1862b331afef2183f. Resources: {'instances', 'ram', 'cores'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:38:08.254043 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-3b2b273d-bef1-4bba-8ae2-6ea663e0349f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Getting quotas for user 0235b8fe92554131ba30e1d18f0f2d86 and project 44dc2a5c754d42d1862b331afef2183f. Resources: {'instances', 'ram', 'cores'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:38:08.264717 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-3b2b273d-bef1-4bba-8ae2-6ea663e0349f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Going to run 1 instances... {{(pid=124711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 15:38:08.267116 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-3b2b273d-bef1-4bba-8ae2-6ea663e0349f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80914b1c-623c-42a8-810e-836b2cce0d3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 15:38:08.430423 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-3b2b273d-bef1-4bba-8ae2-6ea663e0349f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.722756 Jul 20 15:38:08.431044 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 347/705] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Jul 20 15:38:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 15:38:08.440917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d12ba5ae-172c-4c0a-a629-243e35fc1594 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:08.441754 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d12ba5ae-172c-4c0a-a629-243e35fc1594 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:08.496655 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d12ba5ae-172c-4c0a-a629-243e35fc1594 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:08.504928 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-d12ba5ae-172c-4c0a-a629-243e35fc1594 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc" status: 200 len: 1241 microversion: 2.1 time: 0.067743 Jul 20 15:38:08.505665 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 359/706] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:08 2022] GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:38:09.523468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-b902c780-bef2-40c3-b7e2-ffebbe05ef31 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:09.524089 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-b902c780-bef2-40c3-b7e2-ffebbe05ef31 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:09.578238 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-b902c780-bef2-40c3-b7e2-ffebbe05ef31 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:09.585440 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-b902c780-bef2-40c3-b7e2-ffebbe05ef31 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc" status: 200 len: 1241 microversion: 2.1 time: 0.066332 Jul 20 15:38:09.585995 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 348/707] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:09 2022] GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:38:10.602798 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-50e858d8-abcf-4f8e-aa5f-1d804f46c2f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:10.603471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-50e858d8-abcf-4f8e-aa5f-1d804f46c2f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:10.610507 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-50e858d8-abcf-4f8e-aa5f-1d804f46c2f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:10.610959 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-50e858d8-abcf-4f8e-aa5f-1d804f46c2f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:10.611724 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-50e858d8-abcf-4f8e-aa5f-1d804f46c2f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:10.612166 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-50e858d8-abcf-4f8e-aa5f-1d804f46c2f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:10.684639 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-50e858d8-abcf-4f8e-aa5f-1d804f46c2f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:10.693161 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-50e858d8-abcf-4f8e-aa5f-1d804f46c2f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc" status: 200 len: 1293 microversion: 2.1 time: 0.094236 Jul 20 15:38:10.693961 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 360/708] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:10 2022] GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:38:11.355847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-da830b87-3342-4341-9f23-c1d09349cf27 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:11.356387 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-da830b87-3342-4341-9f23-c1d09349cf27 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:11.363311 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-da830b87-3342-4341-9f23-c1d09349cf27 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:11.363876 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-da830b87-3342-4341-9f23-c1d09349cf27 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:11.364723 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-da830b87-3342-4341-9f23-c1d09349cf27 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:11.365225 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-da830b87-3342-4341-9f23-c1d09349cf27 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:11.392025 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-da830b87-3342-4341-9f23-c1d09349cf27 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Going to try to terminate instance {{(pid=124711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 15:38:11.718588 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-21c874a0-510e-4673-920c-04105df18e29 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:11.719543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-21c874a0-510e-4673-920c-04105df18e29 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:11.754102 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-21c874a0-510e-4673-920c-04105df18e29 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:11.755461 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-21c874a0-510e-4673-920c-04105df18e29 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:11.756426 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-21c874a0-510e-4673-920c-04105df18e29 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:11.757038 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-21c874a0-510e-4673-920c-04105df18e29 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:11.774563 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:11.840366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-21c874a0-510e-4673-920c-04105df18e29 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:11.853545 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-21c874a0-510e-4673-920c-04105df18e29 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc" status: 200 len: 1299 microversion: 2.1 time: 0.138959 Jul 20 15:38:11.853545 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 361/709] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:11 2022] GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc => generated 1299 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:38:11.900572 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-da830b87-3342-4341-9f23-c1d09349cf27 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "DELETE /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 204 len: 0 microversion: 2.1 time: 0.548400 Jul 20 15:38:11.901193 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 349/710] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:38:11 2022] DELETE /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 15:38:11.909507 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-f170e57a-1693-4374-89e1-2ea37eed1f7f tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:11.910164 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-f170e57a-1693-4374-89e1-2ea37eed1f7f tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:11.916384 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f170e57a-1693-4374-89e1-2ea37eed1f7f tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:11.916791 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f170e57a-1693-4374-89e1-2ea37eed1f7f tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:11.917549 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f170e57a-1693-4374-89e1-2ea37eed1f7f tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:11.917982 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f170e57a-1693-4374-89e1-2ea37eed1f7f tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:12.153505 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-f170e57a-1693-4374-89e1-2ea37eed1f7f tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:12.169797 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-f170e57a-1693-4374-89e1-2ea37eed1f7f tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1555 microversion: 2.1 time: 0.256172 Jul 20 15:38:12.171452 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 362/711] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:11 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1555 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:38:12.865245 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e47e8337-7462-497d-a941-0e2133c0aac5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:12.866040 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e47e8337-7462-497d-a941-0e2133c0aac5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:12.872483 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e47e8337-7462-497d-a941-0e2133c0aac5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:12.872937 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e47e8337-7462-497d-a941-0e2133c0aac5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:12.873688 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e47e8337-7462-497d-a941-0e2133c0aac5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:12.874113 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e47e8337-7462-497d-a941-0e2133c0aac5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:13.005305 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e47e8337-7462-497d-a941-0e2133c0aac5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:13.013480 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e47e8337-7462-497d-a941-0e2133c0aac5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc" status: 200 len: 1367 microversion: 2.1 time: 0.152518 Jul 20 15:38:13.014109 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 350/712] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:12 2022] GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:38:13.186924 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e7ce8944-bd05-46ab-ac2a-22704d5bad81 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:13.187435 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e7ce8944-bd05-46ab-ac2a-22704d5bad81 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:13.194623 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e7ce8944-bd05-46ab-ac2a-22704d5bad81 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:13.195077 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e7ce8944-bd05-46ab-ac2a-22704d5bad81 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:13.195839 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e7ce8944-bd05-46ab-ac2a-22704d5bad81 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:13.196339 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e7ce8944-bd05-46ab-ac2a-22704d5bad81 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:13.331813 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-e7ce8944-bd05-46ab-ac2a-22704d5bad81 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:13.339958 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-e7ce8944-bd05-46ab-ac2a-22704d5bad81 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1555 microversion: 2.1 time: 0.157057 Jul 20 15:38:13.340521 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 363/713] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:13 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:38:14.030927 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c903074d-0acf-44eb-873f-3888e4ff30f9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:14.031597 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c903074d-0acf-44eb-873f-3888e4ff30f9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:14.038538 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c903074d-0acf-44eb-873f-3888e4ff30f9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:14.038992 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c903074d-0acf-44eb-873f-3888e4ff30f9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:14.039767 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c903074d-0acf-44eb-873f-3888e4ff30f9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:14.040201 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c903074d-0acf-44eb-873f-3888e4ff30f9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:14.043691 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:14.222079 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c903074d-0acf-44eb-873f-3888e4ff30f9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:14.235868 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c903074d-0acf-44eb-873f-3888e4ff30f9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc" status: 200 len: 1367 microversion: 2.1 time: 0.208563 Jul 20 15:38:14.238329 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 351/714] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:14 2022] GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:38:14.358595 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-9ec4df98-c07e-4e48-a784-2ecadaa13f8e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:14.360143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-9ec4df98-c07e-4e48-a784-2ecadaa13f8e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:14.371687 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9ec4df98-c07e-4e48-a784-2ecadaa13f8e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:14.372161 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9ec4df98-c07e-4e48-a784-2ecadaa13f8e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:14.373083 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9ec4df98-c07e-4e48-a784-2ecadaa13f8e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:14.374034 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9ec4df98-c07e-4e48-a784-2ecadaa13f8e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:14.560875 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-9ec4df98-c07e-4e48-a784-2ecadaa13f8e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:14.571473 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-9ec4df98-c07e-4e48-a784-2ecadaa13f8e tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1555 microversion: 2.1 time: 0.218129 Jul 20 15:38:14.585260 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 364/715] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:14 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1555 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:38:14.589535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-5504442c-e84a-4162-87fe-0dcbc112d0a0 req-e27434ce-ab1b-493c-a7b0-77f8b7b547c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0789091-c337-4b8d-b1b5-02144d153dcc", "tag": "8f52bdd8-fb43-4258-ab4f-f2f957867c30"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:38:14.606372 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-5504442c-e84a-4162-87fe-0dcbc112d0a0 req-e27434ce-ab1b-493c-a7b0-77f8b7b547c9 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:14.606821 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-5504442c-e84a-4162-87fe-0dcbc112d0a0 req-e27434ce-ab1b-493c-a7b0-77f8b7b547c9 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:14.619286 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-5504442c-e84a-4162-87fe-0dcbc112d0a0 req-e27434ce-ab1b-493c-a7b0-77f8b7b547c9 service nova] Creating event network-changed:8f52bdd8-fb43-4258-ab4f-f2f957867c30 for instance b0789091-c337-4b8d-b1b5-02144d153dcc on hv-cinder-81914 Jul 20 15:38:14.625246 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-5504442c-e84a-4162-87fe-0dcbc112d0a0 req-e27434ce-ab1b-493c-a7b0-77f8b7b547c9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047632 Jul 20 15:38:14.626550 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 352/716] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:38:14.851980 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-6ab87317-28df-4a35-a0ec-abe464c00782 req-d7bc5211-30a0-4f18-b46d-6c1946a7f50a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "170181c4-a3e8-494d-bef6-2048dd9b0257", "name": "network-vif-deleted", "tag": "3f4230e5-b6b6-43aa-985b-67a345eed1aa"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:38:14.860303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-6ab87317-28df-4a35-a0ec-abe464c00782 req-d7bc5211-30a0-4f18-b46d-6c1946a7f50a service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:14.860684 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-6ab87317-28df-4a35-a0ec-abe464c00782 req-d7bc5211-30a0-4f18-b46d-6c1946a7f50a service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:14.873824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-6ab87317-28df-4a35-a0ec-abe464c00782 req-d7bc5211-30a0-4f18-b46d-6c1946a7f50a service nova] Creating event network-vif-deleted:3f4230e5-b6b6-43aa-985b-67a345eed1aa for instance 170181c4-a3e8-494d-bef6-2048dd9b0257 on hv-cinder-81914 Jul 20 15:38:14.879019 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-6ab87317-28df-4a35-a0ec-abe464c00782 req-d7bc5211-30a0-4f18-b46d-6c1946a7f50a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030770 Jul 20 15:38:14.879628 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 365/717] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:38:15.254510 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-cea626ac-852a-463a-bd1c-10659557c32f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:15.255331 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-cea626ac-852a-463a-bd1c-10659557c32f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:15.263295 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cea626ac-852a-463a-bd1c-10659557c32f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:15.263728 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cea626ac-852a-463a-bd1c-10659557c32f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:15.272361 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cea626ac-852a-463a-bd1c-10659557c32f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:15.272361 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cea626ac-852a-463a-bd1c-10659557c32f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:15.454809 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-cea626ac-852a-463a-bd1c-10659557c32f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:15.462611 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-cea626ac-852a-463a-bd1c-10659557c32f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc" status: 200 len: 1367 microversion: 2.1 time: 0.212860 Jul 20 15:38:15.463173 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 353/718] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:15 2022] GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:38:15.590596 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-50611e19-8a54-4a7f-81be-714ca50ba04a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:15.591295 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-50611e19-8a54-4a7f-81be-714ca50ba04a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:15.597639 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-50611e19-8a54-4a7f-81be-714ca50ba04a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:15.598090 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-50611e19-8a54-4a7f-81be-714ca50ba04a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:15.598890 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-50611e19-8a54-4a7f-81be-714ca50ba04a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:15.599331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-50611e19-8a54-4a7f-81be-714ca50ba04a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:15.632012 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-50611e19-8a54-4a7f-81be-714ca50ba04a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:15.632447 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-50611e19-8a54-4a7f-81be-714ca50ba04a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:15.632887 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.objects.instance [None req-50611e19-8a54-4a7f-81be-714ca50ba04a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lazy-loading 'fault' on Instance uuid 170181c4-a3e8-494d-bef6-2048dd9b0257 {{(pid=124712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:38:15.691387 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-50611e19-8a54-4a7f-81be-714ca50ba04a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:15.699294 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-50611e19-8a54-4a7f-81be-714ca50ba04a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1348 microversion: 2.1 time: 0.113850 Jul 20 15:38:15.699873 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 366/719] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:15 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1348 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:38:16.479727 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ce708ff9-4a7d-4ceb-8be6-4a60dbe153f0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:16.480370 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ce708ff9-4a7d-4ceb-8be6-4a60dbe153f0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:16.487157 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ce708ff9-4a7d-4ceb-8be6-4a60dbe153f0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:16.487602 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ce708ff9-4a7d-4ceb-8be6-4a60dbe153f0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:16.488363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ce708ff9-4a7d-4ceb-8be6-4a60dbe153f0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:16.488793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ce708ff9-4a7d-4ceb-8be6-4a60dbe153f0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:16.630585 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-ce708ff9-4a7d-4ceb-8be6-4a60dbe153f0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:16.639868 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-ce708ff9-4a7d-4ceb-8be6-4a60dbe153f0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc" status: 200 len: 1367 microversion: 2.1 time: 0.163959 Jul 20 15:38:16.640474 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 354/720] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:16 2022] GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:38:16.717362 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-0c992af5-3124-491b-a650-3d94aed33a5a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:16.718034 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-0c992af5-3124-491b-a650-3d94aed33a5a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:16.724925 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0c992af5-3124-491b-a650-3d94aed33a5a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:16.725377 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0c992af5-3124-491b-a650-3d94aed33a5a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:16.726146 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0c992af5-3124-491b-a650-3d94aed33a5a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:16.726612 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0c992af5-3124-491b-a650-3d94aed33a5a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:16.758019 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0c992af5-3124-491b-a650-3d94aed33a5a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:16.762527 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0c992af5-3124-491b-a650-3d94aed33a5a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:16.762527 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.objects.instance [None req-0c992af5-3124-491b-a650-3d94aed33a5a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lazy-loading 'fault' on Instance uuid 170181c4-a3e8-494d-bef6-2048dd9b0257 {{(pid=124712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:38:16.800309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-0c992af5-3124-491b-a650-3d94aed33a5a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce92cce74c84abcbec76358c860535f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8793a880033e400d89ac8de5a30003b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:16.808527 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-0c992af5-3124-491b-a650-3d94aed33a5a tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 200 len: 1348 microversion: 2.1 time: 0.094774 Jul 20 15:38:16.809085 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 367/721] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:16 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 1348 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:38:17.657697 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5dda0034-1b46-4f73-98ed-af3dfbd4a5cb tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:17.658325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5dda0034-1b46-4f73-98ed-af3dfbd4a5cb tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:17.664881 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5dda0034-1b46-4f73-98ed-af3dfbd4a5cb tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:17.665327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5dda0034-1b46-4f73-98ed-af3dfbd4a5cb tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:17.666097 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5dda0034-1b46-4f73-98ed-af3dfbd4a5cb tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:17.666548 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5dda0034-1b46-4f73-98ed-af3dfbd4a5cb tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:17.807662 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5dda0034-1b46-4f73-98ed-af3dfbd4a5cb tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:17.815217 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5dda0034-1b46-4f73-98ed-af3dfbd4a5cb tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc" status: 200 len: 1367 microversion: 2.1 time: 0.161366 Jul 20 15:38:17.815804 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 355/722] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:17 2022] GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:38:17.825481 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b8b83803-2fbe-4823-827d-b759ef32d788 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:17.827474 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b8b83803-2fbe-4823-827d-b759ef32d788 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] [instance: 170181c4-a3e8-494d-bef6-2048dd9b0257] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:17.833818 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b8b83803-2fbe-4823-827d-b759ef32d788 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:17.834290 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b8b83803-2fbe-4823-827d-b759ef32d788 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:17.835063 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b8b83803-2fbe-4823-827d-b759ef32d788 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:17.835530 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b8b83803-2fbe-4823-827d-b759ef32d788 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:17.849173 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-b8b83803-2fbe-4823-827d-b759ef32d788 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] HTTP exception thrown: Instance 170181c4-a3e8-494d-bef6-2048dd9b0257 could not be found. Jul 20 15:38:17.850824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b8b83803-2fbe-4823-827d-b759ef32d788 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Request method failure captured: Jul 20 15:38:17.850824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 HTTP/1.1 Jul 20 15:38:17.850824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:38:17.850824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:38:17.850824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:38:17.850824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:38:17.850824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:38:17.850824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:38:17.850824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:38:17.850824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:38:17.850824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2CB9X7ERZYoaDsAKKr0j8gNo88j5JFlxa2cYxMhOU-KeDrZzyGsK9aOpTFbXNCGWEkN2bD4AFGmUQlchfUUM8cuHNoTuElAogJgaj_430pZSP9SEPTxYbTOmIqownARAzZ4JEbezKQwblXpIiVWYp4KYYNJ5vT3tx0JSI97wCkTW77M Jul 20 15:38:17.850824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:38:17.850824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:38:17.850824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:38:17.850824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:38:17.850824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:38:17.850824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:38:17.850824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 8793a880033e400d89ac8de5a30003b7 Jul 20 15:38:17.850824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-TestMinimumBasicScenario-150647912 Jul 20 15:38:17.850824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:38:17.850824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:38:17.852596 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8793a880033e400d89ac8de5a30003b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8793a880033e400d89ac8de5a30003b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8793a880033e400d89ac8de5a30003b7", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8793a880033e400d89ac8de5a30003b7"}]}] Jul 20 15:38:17.852596 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-TestMinimumBasicScenario-150647912 Jul 20 15:38:17.852596 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 8793a880033e400d89ac8de5a30003b7 Jul 20 15:38:17.852596 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-TestMinimumBasicScenario-150647912 Jul 20 15:38:17.852596 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-TestMinimumBasicScenario-150647912-project Jul 20 15:38:17.852596 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:38:17.852596 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:38:17.852596 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: dce92cce74c84abcbec76358c860535f Jul 20 15:38:17.852596 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-TestMinimumBasicScenario-150647912-project Jul 20 15:38:17.852596 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:38:17.852596 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance 170181c4-a3e8-494d-bef6-2048dd9b0257 could not be found. Jul 20 15:38:17.852596 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': '170181c4-a3e8-494d-bef6-2048dd9b0257'} Jul 20 15:38:17.853390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:38:17.853390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:38:17.853390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:38:17.853390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:38:17.853390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:38:17.853390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:38:17.853390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:38:17.853390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:38:17.853390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:38:17.853390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:38:17.853390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 170181c4-a3e8-494d-bef6-2048dd9b0257 could not be found. Jul 20 15:38:17.853390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:38:17.853390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:38:17.853390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:38:17.853390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:38:17.853390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:38:17.853390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:38:17.853390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:38:17.853390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:38:17.853390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:38:17.855122 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:38:17.855122 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:38:17.855122 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:38:17.855122 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:38:17.855122 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:38:17.855122 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:38:17.855122 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:38:17.855122 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 170181c4-a3e8-494d-bef6-2048dd9b0257 could not be found. Jul 20 15:38:17.855122 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:38:17.855122 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:38:17.855122 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:38:17.855122 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:38:17.855122 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:38:17.855122 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:38:17.855122 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:38:17.855122 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:38:17.855122 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 170181c4-a3e8-494d-bef6-2048dd9b0257 could not be found. Jul 20 15:38:17.855122 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:38:17.856601 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b8b83803-2fbe-4823-827d-b759ef32d788 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Returning 404 to user: Instance 170181c4-a3e8-494d-bef6-2048dd9b0257 could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:38:17.856601 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b8b83803-2fbe-4823-827d-b759ef32d788 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257" status: 404 len: 111 microversion: 2.1 time: 0.031120 Jul 20 15:38:17.856601 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 368/723] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:17 2022] GET /compute/v2.1/servers/170181c4-a3e8-494d-bef6-2048dd9b0257 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:38:17.861091 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-b9f8afb6-f06d-4a55-a08e-21375e1aa754 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] Calling method '.version_select at 0x7efd90985040>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:17.938388 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-b9f8afb6-f06d-4a55-a08e-21375e1aa754 tempest-TestMinimumBasicScenario-150647912 tempest-TestMinimumBasicScenario-150647912-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1683463991" status: 202 len: 0 microversion: 2.1 time: 0.080952 Jul 20 15:38:17.938965 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 356/724] 10.222.0.78 () {58 vars in 1271 bytes} [Wed Jul 20 15:38:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1683463991 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:38:18.833618 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e2627bd2-de78-45bd-bb27-458b3c57c9bc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:18.834366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e2627bd2-de78-45bd-bb27-458b3c57c9bc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:18.836426 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=2 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:18.842858 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e2627bd2-de78-45bd-bb27-458b3c57c9bc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:18.848400 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e2627bd2-de78-45bd-bb27-458b3c57c9bc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:18.848400 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e2627bd2-de78-45bd-bb27-458b3c57c9bc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:18.848400 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e2627bd2-de78-45bd-bb27-458b3c57c9bc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:18.948889 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=2 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:18.954436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-886ebe7b-f3aa-40ce-aa61-5788b1b81d20 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:18.955066 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-886ebe7b-f3aa-40ce-aa61-5788b1b81d20 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:18.957435 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:18.962945 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-886ebe7b-f3aa-40ce-aa61-5788b1b81d20 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:18.964184 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-886ebe7b-f3aa-40ce-aa61-5788b1b81d20 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:18.965033 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-886ebe7b-f3aa-40ce-aa61-5788b1b81d20 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:18.965635 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-886ebe7b-f3aa-40ce-aa61-5788b1b81d20 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:19.001510 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-886ebe7b-f3aa-40ce-aa61-5788b1b81d20 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7/ips" status: 200 len: 152 microversion: 2.20 time: 0.048413 Jul 20 15:38:19.001510 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 357/725] 10.222.0.78 () {60 vars in 1288 bytes} [Wed Jul 20 15:38:18 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7/ips => generated 152 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 15:38:19.005241 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-e2627bd2-de78-45bd-bb27-458b3c57c9bc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:19.013489 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-e2627bd2-de78-45bd-bb27-458b3c57c9bc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc" status: 200 len: 1367 microversion: 2.1 time: 0.184078 Jul 20 15:38:19.014101 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 369/726] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:18 2022] GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:38:19.382695 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-212a725b-9630-4bba-b10f-0ca6487b6fb3 req-100ff843-ac27-4e19-aab5-0291efce0e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0789091-c337-4b8d-b1b5-02144d153dcc", "name": "network-vif-plugged", "status": "completed", "tag": "8f52bdd8-fb43-4258-ab4f-f2f957867c30"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:38:19.392520 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-212a725b-9630-4bba-b10f-0ca6487b6fb3 req-100ff843-ac27-4e19-aab5-0291efce0e86 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:19.392966 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-212a725b-9630-4bba-b10f-0ca6487b6fb3 req-100ff843-ac27-4e19-aab5-0291efce0e86 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:19.408836 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-212a725b-9630-4bba-b10f-0ca6487b6fb3 req-100ff843-ac27-4e19-aab5-0291efce0e86 service nova] Creating event network-vif-plugged:8f52bdd8-fb43-4258-ab4f-f2f957867c30 for instance b0789091-c337-4b8d-b1b5-02144d153dcc on hv-cinder-81914 Jul 20 15:38:19.415605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-212a725b-9630-4bba-b10f-0ca6487b6fb3 req-100ff843-ac27-4e19-aab5-0291efce0e86 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094507 Jul 20 15:38:19.415605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 358/727] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:38:20.030957 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b095f5d5-5d95-46e1-90da-1a8b6e6bb6e0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:20.031565 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b095f5d5-5d95-46e1-90da-1a8b6e6bb6e0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:20.045163 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b095f5d5-5d95-46e1-90da-1a8b6e6bb6e0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:20.045592 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b095f5d5-5d95-46e1-90da-1a8b6e6bb6e0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:20.046393 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b095f5d5-5d95-46e1-90da-1a8b6e6bb6e0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:20.046824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b095f5d5-5d95-46e1-90da-1a8b6e6bb6e0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:20.527265 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b095f5d5-5d95-46e1-90da-1a8b6e6bb6e0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:20.535192 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b095f5d5-5d95-46e1-90da-1a8b6e6bb6e0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc" status: 200 len: 1367 microversion: 2.1 time: 0.508307 Jul 20 15:38:20.535768 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 370/728] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:20 2022] GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc => generated 1367 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:38:21.549904 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=12 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:21.555173 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-98e7399d-a2d3-4a99-a5a9-d76630299ae9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:21.555862 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-98e7399d-a2d3-4a99-a5a9-d76630299ae9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:21.563306 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-98e7399d-a2d3-4a99-a5a9-d76630299ae9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:21.563746 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-98e7399d-a2d3-4a99-a5a9-d76630299ae9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:21.564725 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-98e7399d-a2d3-4a99-a5a9-d76630299ae9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:21.565116 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-98e7399d-a2d3-4a99-a5a9-d76630299ae9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:21.793728 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-98e7399d-a2d3-4a99-a5a9-d76630299ae9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:21.802216 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-98e7399d-a2d3-4a99-a5a9-d76630299ae9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc" status: 200 len: 1367 microversion: 2.1 time: 0.253384 Jul 20 15:38:21.803158 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 359/729] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:21 2022] GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:38:22.151988 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-14fa702a-72ae-493c-ab67-61aff0ccc97d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:38:22.152580 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-14fa702a-72ae-493c-ab67-61aff0ccc97d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:22.158980 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-14fa702a-72ae-493c-ab67-61aff0ccc97d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:22.159435 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-14fa702a-72ae-493c-ab67-61aff0ccc97d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:22.160195 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-14fa702a-72ae-493c-ab67-61aff0ccc97d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:22.160626 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-14fa702a-72ae-493c-ab67-61aff0ccc97d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:22.184804 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.objects.instance [None req-14fa702a-72ae-493c-ab67-61aff0ccc97d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lazy-loading 'flavor' on Instance uuid f1f04603-2085-4cc0-8263-d9c95c31f8a7 {{(pid=124712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:38:22.819774 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5e89130b-269b-4b45-b1af-39855bdaab64 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:22.821036 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5e89130b-269b-4b45-b1af-39855bdaab64 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:22.829876 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e89130b-269b-4b45-b1af-39855bdaab64 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:22.830561 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e89130b-269b-4b45-b1af-39855bdaab64 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:22.831619 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e89130b-269b-4b45-b1af-39855bdaab64 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:22.832521 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e89130b-269b-4b45-b1af-39855bdaab64 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:23.123852 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-14fa702a-72ae-493c-ab67-61aff0ccc97d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "POST /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7/action" status: 202 len: 0 microversion: 2.20 time: 0.974044 Jul 20 15:38:23.123852 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 371/730] 10.222.0.78 () {62 vars in 1318 bytes} [Wed Jul 20 15:38:22 2022] POST /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7/action => generated 0 bytes in 976 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 15:38:23.137414 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-155065c8-3a66-49c8-8330-6c8214a0ac4c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:23.138292 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-155065c8-3a66-49c8-8330-6c8214a0ac4c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:23.146028 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-155065c8-3a66-49c8-8330-6c8214a0ac4c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:23.146732 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-155065c8-3a66-49c8-8330-6c8214a0ac4c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:23.148033 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-155065c8-3a66-49c8-8330-6c8214a0ac4c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:23.148794 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-155065c8-3a66-49c8-8330-6c8214a0ac4c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:23.208623 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5e89130b-269b-4b45-b1af-39855bdaab64 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:23.216588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5e89130b-269b-4b45-b1af-39855bdaab64 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc" status: 200 len: 1557 microversion: 2.1 time: 0.400878 Jul 20 15:38:23.217346 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 360/731] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:22 2022] GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc => generated 1557 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:38:23.233840 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-db6ea085-60dd-4194-b711-dc14b8a12729 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:23.234348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-db6ea085-60dd-4194-b711-dc14b8a12729 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:23.240806 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-db6ea085-60dd-4194-b711-dc14b8a12729 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:23.241276 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-db6ea085-60dd-4194-b711-dc14b8a12729 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:23.242126 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-db6ea085-60dd-4194-b711-dc14b8a12729 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:23.242930 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-db6ea085-60dd-4194-b711-dc14b8a12729 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:23.333777 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-155065c8-3a66-49c8-8330-6c8214a0ac4c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:23.341938 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-155065c8-3a66-49c8-8330-6c8214a0ac4c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:23.343573 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-155065c8-3a66-49c8-8330-6c8214a0ac4c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:23.344823 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-155065c8-3a66-49c8-8330-6c8214a0ac4c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1722 microversion: 2.20 time: 0.214552 Jul 20 15:38:23.345462 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 372/732] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:23 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:38:23.345726 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-db6ea085-60dd-4194-b711-dc14b8a12729 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.115969 Jul 20 15:38:23.346485 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 361/733] 10.222.0.78 () {58 vars in 1274 bytes} [Wed Jul 20 15:38:23 2022] GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:38:24.363517 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-55d4186a-33dd-4800-9192-b4e26b387221 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:24.364237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-55d4186a-33dd-4800-9192-b4e26b387221 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:24.371597 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-55d4186a-33dd-4800-9192-b4e26b387221 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:24.372133 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-55d4186a-33dd-4800-9192-b4e26b387221 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:24.373036 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-55d4186a-33dd-4800-9192-b4e26b387221 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:24.373542 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-55d4186a-33dd-4800-9192-b4e26b387221 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:24.590069 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-55d4186a-33dd-4800-9192-b4e26b387221 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:24.599833 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-55d4186a-33dd-4800-9192-b4e26b387221 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:24.602315 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-55d4186a-33dd-4800-9192-b4e26b387221 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:24.603949 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-55d4186a-33dd-4800-9192-b4e26b387221 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1722 microversion: 2.20 time: 0.244746 Jul 20 15:38:24.604949 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 373/734] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:24 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1722 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:38:24.723444 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-6e3e8375-6b74-4075-8642-074236fc2927 req-172e9634-1341-4497-b3ef-ca126f83a1bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0789091-c337-4b8d-b1b5-02144d153dcc", "tag": "8f52bdd8-fb43-4258-ab4f-f2f957867c30"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:38:24.730285 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-6e3e8375-6b74-4075-8642-074236fc2927 req-172e9634-1341-4497-b3ef-ca126f83a1bf service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:24.731873 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-6e3e8375-6b74-4075-8642-074236fc2927 req-172e9634-1341-4497-b3ef-ca126f83a1bf service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:24.749862 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-6e3e8375-6b74-4075-8642-074236fc2927 req-172e9634-1341-4497-b3ef-ca126f83a1bf service nova] Creating event network-changed:8f52bdd8-fb43-4258-ab4f-f2f957867c30 for instance b0789091-c337-4b8d-b1b5-02144d153dcc on hv-cinder-81914 Jul 20 15:38:24.760166 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-6e3e8375-6b74-4075-8642-074236fc2927 req-172e9634-1341-4497-b3ef-ca126f83a1bf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046165 Jul 20 15:38:24.763262 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 362/735] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:38:25.627836 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-dd9a44ea-cc82-4086-a488-f4576f9a9452 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:25.628802 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-dd9a44ea-cc82-4086-a488-f4576f9a9452 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:25.636466 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dd9a44ea-cc82-4086-a488-f4576f9a9452 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:25.642882 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dd9a44ea-cc82-4086-a488-f4576f9a9452 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:25.642882 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dd9a44ea-cc82-4086-a488-f4576f9a9452 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:25.642882 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dd9a44ea-cc82-4086-a488-f4576f9a9452 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:25.924122 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-dd9a44ea-cc82-4086-a488-f4576f9a9452 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:25.933295 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-dd9a44ea-cc82-4086-a488-f4576f9a9452 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:25.935043 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-dd9a44ea-cc82-4086-a488-f4576f9a9452 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:25.936426 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-dd9a44ea-cc82-4086-a488-f4576f9a9452 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1722 microversion: 2.20 time: 0.317662 Jul 20 15:38:25.937014 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 374/736] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:25 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1722 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:38:26.561532 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-a362e876-cffd-43d0-a4f9-68d7c62f1170 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:26.562149 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-a362e876-cffd-43d0-a4f9-68d7c62f1170 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:26.569626 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a362e876-cffd-43d0-a4f9-68d7c62f1170 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:26.570071 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a362e876-cffd-43d0-a4f9-68d7c62f1170 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:26.570867 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a362e876-cffd-43d0-a4f9-68d7c62f1170 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:26.571296 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a362e876-cffd-43d0-a4f9-68d7c62f1170 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:26.600093 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-a362e876-cffd-43d0-a4f9-68d7c62f1170 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/ips" status: 200 len: 146 microversion: 2.1 time: 0.044197 Jul 20 15:38:26.600685 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 363/737] 10.222.0.78 () {58 vars in 1247 bytes} [Wed Jul 20 15:38:26 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/ips => generated 146 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:38:26.954923 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-735578f1-6d55-496e-9dd6-cf628ce44a47 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:26.955541 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-735578f1-6d55-496e-9dd6-cf628ce44a47 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:26.962693 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-735578f1-6d55-496e-9dd6-cf628ce44a47 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:26.963637 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-735578f1-6d55-496e-9dd6-cf628ce44a47 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:26.965489 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-735578f1-6d55-496e-9dd6-cf628ce44a47 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:26.965929 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-735578f1-6d55-496e-9dd6-cf628ce44a47 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:27.191623 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-735578f1-6d55-496e-9dd6-cf628ce44a47 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:27.192836 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-735578f1-6d55-496e-9dd6-cf628ce44a47 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:27.194557 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-735578f1-6d55-496e-9dd6-cf628ce44a47 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:27.196069 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-735578f1-6d55-496e-9dd6-cf628ce44a47 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1722 microversion: 2.20 time: 0.245083 Jul 20 15:38:27.208747 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 375/738] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:26 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:38:28.217877 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-93ccc814-7909-4637-8ac9-f65b608c85fa tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:28.218758 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-93ccc814-7909-4637-8ac9-f65b608c85fa tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:28.230746 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-93ccc814-7909-4637-8ac9-f65b608c85fa tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:28.233192 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-93ccc814-7909-4637-8ac9-f65b608c85fa tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:28.233192 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-93ccc814-7909-4637-8ac9-f65b608c85fa tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:28.233192 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-93ccc814-7909-4637-8ac9-f65b608c85fa tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:28.329270 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-36ef7806-81bb-4430-82e6-7ab76d9bcb5d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9e937fd-096f-4132-8d90-fd1a7aa8a0f3"}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:38:28.331572 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-36ef7806-81bb-4430-82e6-7ab76d9bcb5d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:28.339478 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-36ef7806-81bb-4430-82e6-7ab76d9bcb5d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:28.339665 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-36ef7806-81bb-4430-82e6-7ab76d9bcb5d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:28.340419 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-36ef7806-81bb-4430-82e6-7ab76d9bcb5d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:28.340880 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-36ef7806-81bb-4430-82e6-7ab76d9bcb5d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:28.401931 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-93ccc814-7909-4637-8ac9-f65b608c85fa tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:28.412228 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-93ccc814-7909-4637-8ac9-f65b608c85fa tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:28.414085 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-93ccc814-7909-4637-8ac9-f65b608c85fa tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:28.415395 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-93ccc814-7909-4637-8ac9-f65b608c85fa tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1722 microversion: 2.20 time: 0.201674 Jul 20 15:38:28.416038 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 364/739] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:28 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:38:28.428399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:29.433130 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-af18bf24-bb12-4a7d-bb83-4979d46dc83f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:29.433645 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-af18bf24-bb12-4a7d-bb83-4979d46dc83f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:29.440221 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-af18bf24-bb12-4a7d-bb83-4979d46dc83f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:29.440655 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-af18bf24-bb12-4a7d-bb83-4979d46dc83f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:29.441409 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-af18bf24-bb12-4a7d-bb83-4979d46dc83f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:29.441836 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-af18bf24-bb12-4a7d-bb83-4979d46dc83f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:29.488877 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-36ef7806-81bb-4430-82e6-7ab76d9bcb5d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "POST /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.163516 Jul 20 15:38:29.489505 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 376/740] 10.222.0.78 () {60 vars in 1322 bytes} [Wed Jul 20 15:38:28 2022] POST /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-volume_attachments => generated 194 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:38:29.634343 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-af18bf24-bb12-4a7d-bb83-4979d46dc83f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:29.643872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-af18bf24-bb12-4a7d-bb83-4979d46dc83f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:29.645362 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-af18bf24-bb12-4a7d-bb83-4979d46dc83f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:29.646606 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-af18bf24-bb12-4a7d-bb83-4979d46dc83f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1722 microversion: 2.20 time: 0.217475 Jul 20 15:38:29.647157 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 365/741] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:29 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:38:30.670982 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-f84197dd-818d-4e17-bf63-3d03c679ee5e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:30.671553 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-f84197dd-818d-4e17-bf63-3d03c679ee5e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:30.679525 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f84197dd-818d-4e17-bf63-3d03c679ee5e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:30.680042 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f84197dd-818d-4e17-bf63-3d03c679ee5e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:30.680820 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f84197dd-818d-4e17-bf63-3d03c679ee5e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:30.681252 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f84197dd-818d-4e17-bf63-3d03c679ee5e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:30.814219 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-f84197dd-818d-4e17-bf63-3d03c679ee5e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:30.822570 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-f84197dd-818d-4e17-bf63-3d03c679ee5e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:30.824080 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-f84197dd-818d-4e17-bf63-3d03c679ee5e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:30.825239 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-f84197dd-818d-4e17-bf63-3d03c679ee5e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1722 microversion: 2.20 time: 0.164712 Jul 20 15:38:30.825959 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 377/742] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:30 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:38:31.844018 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-bb682f27-924d-4cbc-a548-d2b062676659 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:31.844631 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-bb682f27-924d-4cbc-a548-d2b062676659 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:31.851416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bb682f27-924d-4cbc-a548-d2b062676659 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:31.851867 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bb682f27-924d-4cbc-a548-d2b062676659 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:31.852704 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bb682f27-924d-4cbc-a548-d2b062676659 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:31.853142 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bb682f27-924d-4cbc-a548-d2b062676659 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:31.987933 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-bb682f27-924d-4cbc-a548-d2b062676659 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:31.996727 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-bb682f27-924d-4cbc-a548-d2b062676659 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:31.998220 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-bb682f27-924d-4cbc-a548-d2b062676659 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:31.999428 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-bb682f27-924d-4cbc-a548-d2b062676659 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1722 microversion: 2.20 time: 0.159215 Jul 20 15:38:31.999992 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 366/743] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:31 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:38:33.018960 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-04568c57-20f5-4633-8de4-f72895d12a35 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:33.019731 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-04568c57-20f5-4633-8de4-f72895d12a35 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:33.026728 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-04568c57-20f5-4633-8de4-f72895d12a35 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:33.027218 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-04568c57-20f5-4633-8de4-f72895d12a35 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:33.027963 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-04568c57-20f5-4633-8de4-f72895d12a35 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:33.028424 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-04568c57-20f5-4633-8de4-f72895d12a35 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:33.162126 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-04568c57-20f5-4633-8de4-f72895d12a35 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:33.170976 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-04568c57-20f5-4633-8de4-f72895d12a35 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:33.172501 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-04568c57-20f5-4633-8de4-f72895d12a35 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:33.173677 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-04568c57-20f5-4633-8de4-f72895d12a35 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1722 microversion: 2.20 time: 0.158776 Jul 20 15:38:33.174239 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 378/744] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:33 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:38:34.193004 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-9e97cf0b-222c-4dfd-bf66-51fb8a94866c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:34.193611 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-9e97cf0b-222c-4dfd-bf66-51fb8a94866c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:34.200760 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9e97cf0b-222c-4dfd-bf66-51fb8a94866c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:34.201200 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9e97cf0b-222c-4dfd-bf66-51fb8a94866c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:34.201963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9e97cf0b-222c-4dfd-bf66-51fb8a94866c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:34.202429 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9e97cf0b-222c-4dfd-bf66-51fb8a94866c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:34.338193 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-9e97cf0b-222c-4dfd-bf66-51fb8a94866c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:34.346763 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-9e97cf0b-222c-4dfd-bf66-51fb8a94866c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:34.348182 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-9e97cf0b-222c-4dfd-bf66-51fb8a94866c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:34.349593 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-9e97cf0b-222c-4dfd-bf66-51fb8a94866c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1722 microversion: 2.20 time: 0.160665 Jul 20 15:38:34.350162 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 367/745] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:34 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:38:35.369287 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-caee107c-2b8e-4222-bb99-0ddaebb8d674 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:35.369985 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-caee107c-2b8e-4222-bb99-0ddaebb8d674 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:35.372415 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=58 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:35.377501 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-caee107c-2b8e-4222-bb99-0ddaebb8d674 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:35.377945 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-caee107c-2b8e-4222-bb99-0ddaebb8d674 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:35.378733 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-caee107c-2b8e-4222-bb99-0ddaebb8d674 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:35.379158 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-caee107c-2b8e-4222-bb99-0ddaebb8d674 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:35.519849 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-caee107c-2b8e-4222-bb99-0ddaebb8d674 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:35.528646 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-caee107c-2b8e-4222-bb99-0ddaebb8d674 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:35.530149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-caee107c-2b8e-4222-bb99-0ddaebb8d674 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:35.531347 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-caee107c-2b8e-4222-bb99-0ddaebb8d674 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1722 microversion: 2.20 time: 0.166171 Jul 20 15:38:35.531906 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 379/746] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:35 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:38:36.550589 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-82b2a578-fb48-4b99-b3c4-a5c783ef5f08 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:36.551245 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-82b2a578-fb48-4b99-b3c4-a5c783ef5f08 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:36.558516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-82b2a578-fb48-4b99-b3c4-a5c783ef5f08 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:36.558962 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-82b2a578-fb48-4b99-b3c4-a5c783ef5f08 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:36.559736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-82b2a578-fb48-4b99-b3c4-a5c783ef5f08 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:36.560216 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-82b2a578-fb48-4b99-b3c4-a5c783ef5f08 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:36.697202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-82b2a578-fb48-4b99-b3c4-a5c783ef5f08 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:36.705817 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-82b2a578-fb48-4b99-b3c4-a5c783ef5f08 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:36.707626 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-82b2a578-fb48-4b99-b3c4-a5c783ef5f08 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:36.708836 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-82b2a578-fb48-4b99-b3c4-a5c783ef5f08 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1722 microversion: 2.20 time: 0.162217 Jul 20 15:38:36.709407 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 368/747] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:36 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:38:37.047685 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-5065babd-c485-4fb0-a296-d8a1f6445985 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:37.048602 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-5065babd-c485-4fb0-a296-d8a1f6445985 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:37.055141 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5065babd-c485-4fb0-a296-d8a1f6445985 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:37.055585 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5065babd-c485-4fb0-a296-d8a1f6445985 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:37.056332 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5065babd-c485-4fb0-a296-d8a1f6445985 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:37.056802 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5065babd-c485-4fb0-a296-d8a1f6445985 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:37.087729 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-5065babd-c485-4fb0-a296-d8a1f6445985 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043881 Jul 20 15:38:37.088209 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 380/748] 10.222.0.78 () {58 vars in 1301 bytes} [Wed Jul 20 15:38:37 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:38:37.099692 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-fea6245b-840b-4010-8124-1d6b8b325f9d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:37.100183 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-fea6245b-840b-4010-8124-1d6b8b325f9d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:37.106232 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fea6245b-840b-4010-8124-1d6b8b325f9d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:37.106770 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fea6245b-840b-4010-8124-1d6b8b325f9d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:37.107554 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fea6245b-840b-4010-8124-1d6b8b325f9d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:37.108001 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fea6245b-840b-4010-8124-1d6b8b325f9d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:37.135500 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-fea6245b-840b-4010-8124-1d6b8b325f9d tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-volume_attachments/e9e937fd-096f-4132-8d90-fd1a7aa8a0f3" status: 200 len: 194 microversion: 2.1 time: 0.039819 Jul 20 15:38:37.136069 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 369/749] 10.222.0.78 () {58 vars in 1412 bytes} [Wed Jul 20 15:38:37 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-volume_attachments/e9e937fd-096f-4132-8d90-fd1a7aa8a0f3 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:38:37.727495 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-44404eaf-62df-4a5a-a581-f0aa2e19298d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:37.727984 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-44404eaf-62df-4a5a-a581-f0aa2e19298d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:37.738673 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-44404eaf-62df-4a5a-a581-f0aa2e19298d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:37.738673 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-44404eaf-62df-4a5a-a581-f0aa2e19298d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:37.738673 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-44404eaf-62df-4a5a-a581-f0aa2e19298d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:37.738673 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-44404eaf-62df-4a5a-a581-f0aa2e19298d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:37.869000 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-44404eaf-62df-4a5a-a581-f0aa2e19298d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:37.880127 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-44404eaf-62df-4a5a-a581-f0aa2e19298d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:37.881728 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-44404eaf-62df-4a5a-a581-f0aa2e19298d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:37.883166 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-44404eaf-62df-4a5a-a581-f0aa2e19298d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1722 microversion: 2.20 time: 0.159414 Jul 20 15:38:37.883733 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 381/750] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:37 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:38:38.900968 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-f46b444d-5091-490e-8b33-377c280dcdd4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:38.901571 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-f46b444d-5091-490e-8b33-377c280dcdd4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:38.908844 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f46b444d-5091-490e-8b33-377c280dcdd4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:38.909284 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f46b444d-5091-490e-8b33-377c280dcdd4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:38.910038 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f46b444d-5091-490e-8b33-377c280dcdd4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:38.910490 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f46b444d-5091-490e-8b33-377c280dcdd4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:38.980063 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-c75331de-0aa7-4d5a-96e1-e0ab4b2748b9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0b329fd-1dea-4214-ab04-58d90c85d85e"}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:38:38.981666 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-c75331de-0aa7-4d5a-96e1-e0ab4b2748b9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:38.988182 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c75331de-0aa7-4d5a-96e1-e0ab4b2748b9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:38.988634 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c75331de-0aa7-4d5a-96e1-e0ab4b2748b9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:38.989421 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c75331de-0aa7-4d5a-96e1-e0ab4b2748b9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:38.990076 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c75331de-0aa7-4d5a-96e1-e0ab4b2748b9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:39.042411 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-f46b444d-5091-490e-8b33-377c280dcdd4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:39.051104 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-f46b444d-5091-490e-8b33-377c280dcdd4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:39.052858 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-f46b444d-5091-490e-8b33-377c280dcdd4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:39.054004 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-f46b444d-5091-490e-8b33-377c280dcdd4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1722 microversion: 2.20 time: 0.156991 Jul 20 15:38:39.054613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 370/751] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:38 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:38:40.020507 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-c75331de-0aa7-4d5a-96e1-e0ab4b2748b9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "POST /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.044198 Jul 20 15:38:40.021189 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 382/752] 10.222.0.78 () {60 vars in 1322 bytes} [Wed Jul 20 15:38:38 2022] POST /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-volume_attachments => generated 194 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:38:40.073623 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e5acd2d1-983d-4090-b1cf-8e4d117ab7f1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:40.074788 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e5acd2d1-983d-4090-b1cf-8e4d117ab7f1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:40.082109 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e5acd2d1-983d-4090-b1cf-8e4d117ab7f1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:40.082797 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e5acd2d1-983d-4090-b1cf-8e4d117ab7f1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:40.083582 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e5acd2d1-983d-4090-b1cf-8e4d117ab7f1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:40.084079 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e5acd2d1-983d-4090-b1cf-8e4d117ab7f1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:40.219391 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e5acd2d1-983d-4090-b1cf-8e4d117ab7f1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:40.221836 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=100 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:40.228358 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e5acd2d1-983d-4090-b1cf-8e4d117ab7f1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:40.229869 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e5acd2d1-983d-4090-b1cf-8e4d117ab7f1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:40.231154 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e5acd2d1-983d-4090-b1cf-8e4d117ab7f1 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1722 microversion: 2.20 time: 0.161622 Jul 20 15:38:40.231711 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 371/753] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:40 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:38:41.249741 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-94768210-544f-48af-8a15-6969b29e2030 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:41.255505 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-94768210-544f-48af-8a15-6969b29e2030 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:41.256761 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-94768210-544f-48af-8a15-6969b29e2030 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:41.257209 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-94768210-544f-48af-8a15-6969b29e2030 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:41.257961 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-94768210-544f-48af-8a15-6969b29e2030 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:41.258434 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-94768210-544f-48af-8a15-6969b29e2030 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:41.391820 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-94768210-544f-48af-8a15-6969b29e2030 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:41.399800 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-94768210-544f-48af-8a15-6969b29e2030 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:41.401308 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-94768210-544f-48af-8a15-6969b29e2030 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:41.403151 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-94768210-544f-48af-8a15-6969b29e2030 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1722 microversion: 2.20 time: 0.158300 Jul 20 15:38:41.403662 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 383/754] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:41 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:38:42.422052 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ab605d3e-c419-4b86-83be-173b39a46fb2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:42.422675 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ab605d3e-c419-4b86-83be-173b39a46fb2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:42.429404 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ab605d3e-c419-4b86-83be-173b39a46fb2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:42.429843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ab605d3e-c419-4b86-83be-173b39a46fb2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:42.430612 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ab605d3e-c419-4b86-83be-173b39a46fb2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:42.431038 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ab605d3e-c419-4b86-83be-173b39a46fb2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:42.563351 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-ab605d3e-c419-4b86-83be-173b39a46fb2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:42.571421 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-ab605d3e-c419-4b86-83be-173b39a46fb2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:42.573061 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-ab605d3e-c419-4b86-83be-173b39a46fb2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:42.574243 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-ab605d3e-c419-4b86-83be-173b39a46fb2 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1722 microversion: 2.20 time: 0.156986 Jul 20 15:38:42.574847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 372/755] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:42 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:38:43.592548 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-5bb691ee-9f02-424a-b5fd-7e8b63322f01 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:43.593149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-5bb691ee-9f02-424a-b5fd-7e8b63322f01 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:43.599691 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5bb691ee-9f02-424a-b5fd-7e8b63322f01 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:43.600139 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5bb691ee-9f02-424a-b5fd-7e8b63322f01 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:43.600922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5bb691ee-9f02-424a-b5fd-7e8b63322f01 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:43.601356 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5bb691ee-9f02-424a-b5fd-7e8b63322f01 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:43.741203 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-5bb691ee-9f02-424a-b5fd-7e8b63322f01 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:43.749764 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-5bb691ee-9f02-424a-b5fd-7e8b63322f01 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:43.751310 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-5bb691ee-9f02-424a-b5fd-7e8b63322f01 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:43.752500 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-5bb691ee-9f02-424a-b5fd-7e8b63322f01 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1722 microversion: 2.20 time: 0.163941 Jul 20 15:38:43.753053 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 384/756] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:43 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:38:44.770729 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-1c1dd266-cf79-4a33-9265-395a5fad7304 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:44.771328 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-1c1dd266-cf79-4a33-9265-395a5fad7304 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:44.777947 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1c1dd266-cf79-4a33-9265-395a5fad7304 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:44.778436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1c1dd266-cf79-4a33-9265-395a5fad7304 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:44.779201 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1c1dd266-cf79-4a33-9265-395a5fad7304 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:44.779637 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1c1dd266-cf79-4a33-9265-395a5fad7304 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:44.913781 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-1c1dd266-cf79-4a33-9265-395a5fad7304 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:44.922884 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-1c1dd266-cf79-4a33-9265-395a5fad7304 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:44.924392 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-1c1dd266-cf79-4a33-9265-395a5fad7304 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:44.925540 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-1c1dd266-cf79-4a33-9265-395a5fad7304 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1743 microversion: 2.20 time: 0.158748 Jul 20 15:38:44.926093 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 373/757] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:44 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:38:45.943799 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-05e3a851-ab7a-4007-9421-a7214c877d75 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:45.944371 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-05e3a851-ab7a-4007-9421-a7214c877d75 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:45.951435 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-05e3a851-ab7a-4007-9421-a7214c877d75 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:45.951879 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-05e3a851-ab7a-4007-9421-a7214c877d75 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:45.952619 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-05e3a851-ab7a-4007-9421-a7214c877d75 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:45.953046 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-05e3a851-ab7a-4007-9421-a7214c877d75 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:46.087811 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-05e3a851-ab7a-4007-9421-a7214c877d75 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:46.096824 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-05e3a851-ab7a-4007-9421-a7214c877d75 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:46.099098 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-05e3a851-ab7a-4007-9421-a7214c877d75 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:46.100343 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-05e3a851-ab7a-4007-9421-a7214c877d75 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1743 microversion: 2.20 time: 0.160396 Jul 20 15:38:46.100939 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 385/758] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:45 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:38:47.118430 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ee58c4f3-8990-4fa9-b587-105ccada6570 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:47.119160 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ee58c4f3-8990-4fa9-b587-105ccada6570 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:47.126132 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ee58c4f3-8990-4fa9-b587-105ccada6570 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:47.126662 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ee58c4f3-8990-4fa9-b587-105ccada6570 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:47.128374 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ee58c4f3-8990-4fa9-b587-105ccada6570 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:47.128684 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ee58c4f3-8990-4fa9-b587-105ccada6570 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:47.257963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-ee58c4f3-8990-4fa9-b587-105ccada6570 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:47.267152 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-ee58c4f3-8990-4fa9-b587-105ccada6570 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:47.268754 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-ee58c4f3-8990-4fa9-b587-105ccada6570 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:47.269970 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-ee58c4f3-8990-4fa9-b587-105ccada6570 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1743 microversion: 2.20 time: 0.155493 Jul 20 15:38:47.270584 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 374/759] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:47 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:38:48.288317 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-6eba9b5b-0dfb-4a0a-9028-92edcbef4a79 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:48.288922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-6eba9b5b-0dfb-4a0a-9028-92edcbef4a79 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:48.295565 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6eba9b5b-0dfb-4a0a-9028-92edcbef4a79 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:48.296010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6eba9b5b-0dfb-4a0a-9028-92edcbef4a79 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:48.296770 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6eba9b5b-0dfb-4a0a-9028-92edcbef4a79 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:48.297203 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6eba9b5b-0dfb-4a0a-9028-92edcbef4a79 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:48.448141 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-6eba9b5b-0dfb-4a0a-9028-92edcbef4a79 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:48.459757 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-6eba9b5b-0dfb-4a0a-9028-92edcbef4a79 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:48.461247 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-6eba9b5b-0dfb-4a0a-9028-92edcbef4a79 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:48.465971 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-6eba9b5b-0dfb-4a0a-9028-92edcbef4a79 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1738 microversion: 2.20 time: 0.178011 Jul 20 15:38:48.477975 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 386/760] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:48 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:38:48.586143 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-7fb7e9c4-8ff6-46bd-b56d-58592e32af90 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:48.587304 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-7fb7e9c4-8ff6-46bd-b56d-58592e32af90 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:48.597424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7fb7e9c4-8ff6-46bd-b56d-58592e32af90 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:48.597766 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7fb7e9c4-8ff6-46bd-b56d-58592e32af90 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:48.598555 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7fb7e9c4-8ff6-46bd-b56d-58592e32af90 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:48.599205 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7fb7e9c4-8ff6-46bd-b56d-58592e32af90 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:48.636228 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-7fb7e9c4-8ff6-46bd-b56d-58592e32af90 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054569 Jul 20 15:38:48.640644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 375/761] 10.222.0.78 () {58 vars in 1301 bytes} [Wed Jul 20 15:38:48 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:38:48.782654 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-25687f3b-fbbc-4a2b-8f75-959b70251bec tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:48.783149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-25687f3b-fbbc-4a2b-8f75-959b70251bec tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:48.800381 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-25687f3b-fbbc-4a2b-8f75-959b70251bec tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:48.800381 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-25687f3b-fbbc-4a2b-8f75-959b70251bec tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:48.800381 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-25687f3b-fbbc-4a2b-8f75-959b70251bec tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:48.800381 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-25687f3b-fbbc-4a2b-8f75-959b70251bec tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:48.844665 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-25687f3b-fbbc-4a2b-8f75-959b70251bec tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-volume_attachments/e9e937fd-096f-4132-8d90-fd1a7aa8a0f3" status: 200 len: 194 microversion: 2.1 time: 0.064830 Jul 20 15:38:48.845792 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 387/762] 10.222.0.78 () {58 vars in 1412 bytes} [Wed Jul 20 15:38:48 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-volume_attachments/e9e937fd-096f-4132-8d90-fd1a7aa8a0f3 => generated 194 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:38:48.854331 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e392410b-ad3b-40d8-bf85-067ea3804e77 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:48.854901 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e392410b-ad3b-40d8-bf85-067ea3804e77 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:48.861824 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e392410b-ad3b-40d8-bf85-067ea3804e77 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:48.862295 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e392410b-ad3b-40d8-bf85-067ea3804e77 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:48.863118 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e392410b-ad3b-40d8-bf85-067ea3804e77 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:48.863563 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e392410b-ad3b-40d8-bf85-067ea3804e77 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:48.953289 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.objects.instance [None req-e392410b-ad3b-40d8-bf85-067ea3804e77 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lazy-loading 'services' on Instance uuid a0f28926-7b36-49a2-bd27-7b7006fa992e {{(pid=124711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:38:49.189004 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-33c5f51d-0731-49ce-b982-93e701e753ec req-e558dc6f-9201-4bb8-a9e0-1a1f500f2fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1f04603-2085-4cc0-8263-d9c95c31f8a7", "name": "network-vif-plugged", "status": "completed", "tag": "a14d5f16-fe56-45ba-b07b-4affc5762962"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:38:49.197678 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-33c5f51d-0731-49ce-b982-93e701e753ec req-e558dc6f-9201-4bb8-a9e0-1a1f500f2fc7 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:49.198191 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-33c5f51d-0731-49ce-b982-93e701e753ec req-e558dc6f-9201-4bb8-a9e0-1a1f500f2fc7 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:49.209719 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e392410b-ad3b-40d8-bf85-067ea3804e77 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-volume_attachments/e9e937fd-096f-4132-8d90-fd1a7aa8a0f3" status: 202 len: 0 microversion: 2.1 time: 0.358980 Jul 20 15:38:49.210799 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 376/763] 10.222.0.78 () {58 vars in 1415 bytes} [Wed Jul 20 15:38:48 2022] DELETE /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-volume_attachments/e9e937fd-096f-4132-8d90-fd1a7aa8a0f3 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:38:49.212578 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-33c5f51d-0731-49ce-b982-93e701e753ec req-e558dc6f-9201-4bb8-a9e0-1a1f500f2fc7 service nova] Creating event network-vif-plugged:a14d5f16-fe56-45ba-b07b-4affc5762962 for instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 on hv-cinder-81914 Jul 20 15:38:49.249248 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-33c5f51d-0731-49ce-b982-93e701e753ec req-e558dc6f-9201-4bb8-a9e0-1a1f500f2fc7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064101 Jul 20 15:38:49.250176 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 388/764] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:38:49.487108 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d3c7f89d-edb0-4f54-86b9-fd8f7c9d3225 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:49.487829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-d3c7f89d-edb0-4f54-86b9-fd8f7c9d3225 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:49.496158 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d3c7f89d-edb0-4f54-86b9-fd8f7c9d3225 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:49.498875 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d3c7f89d-edb0-4f54-86b9-fd8f7c9d3225 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:49.498875 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d3c7f89d-edb0-4f54-86b9-fd8f7c9d3225 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:49.498875 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d3c7f89d-edb0-4f54-86b9-fd8f7c9d3225 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:50.043149 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d3c7f89d-edb0-4f54-86b9-fd8f7c9d3225 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:50.056473 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d3c7f89d-edb0-4f54-86b9-fd8f7c9d3225 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:50.058511 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d3c7f89d-edb0-4f54-86b9-fd8f7c9d3225 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:50.059894 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d3c7f89d-edb0-4f54-86b9-fd8f7c9d3225 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1738 microversion: 2.20 time: 0.577944 Jul 20 15:38:50.060624 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 377/765] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:49 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1738 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:38:50.443917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-41153aa8-e2b4-4a07-9038-bc1973df1457 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:38:50.445531 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-41153aa8-e2b4-4a07-9038-bc1973df1457 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:50.454937 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-41153aa8-e2b4-4a07-9038-bc1973df1457 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:50.455671 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-41153aa8-e2b4-4a07-9038-bc1973df1457 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:50.456692 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-41153aa8-e2b4-4a07-9038-bc1973df1457 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:50.457190 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-41153aa8-e2b4-4a07-9038-bc1973df1457 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:50.493014 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.objects.instance [None req-41153aa8-e2b4-4a07-9038-bc1973df1457 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lazy-loading 'flavor' on Instance uuid 562e58cb-a1c0-4582-b4aa-46abf6053c11 {{(pid=124712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:38:50.818867 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=6,nova_cell1:INSERT=2 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:50.985426 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-41153aa8-e2b4-4a07-9038-bc1973df1457 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "POST /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11/action" status: 202 len: 0 microversion: 2.1 time: 0.547195 Jul 20 15:38:50.986383 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 389/766] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Jul 20 15:38:50 2022] POST /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:38:50.998479 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-bc70abc7-764b-4ae3-9347-11c3134d64fc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:50.999507 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-bc70abc7-764b-4ae3-9347-11c3134d64fc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:51.007779 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bc70abc7-764b-4ae3-9347-11c3134d64fc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:51.008319 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bc70abc7-764b-4ae3-9347-11c3134d64fc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:51.009179 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bc70abc7-764b-4ae3-9347-11c3134d64fc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:51.009682 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bc70abc7-764b-4ae3-9347-11c3134d64fc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:51.085354 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-30ec5522-72d6-4eb2-b448-e8fbdf2c8ee8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:51.086169 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-30ec5522-72d6-4eb2-b448-e8fbdf2c8ee8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:51.096105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-30ec5522-72d6-4eb2-b448-e8fbdf2c8ee8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:51.097598 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-30ec5522-72d6-4eb2-b448-e8fbdf2c8ee8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:51.099137 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-30ec5522-72d6-4eb2-b448-e8fbdf2c8ee8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:51.099982 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-30ec5522-72d6-4eb2-b448-e8fbdf2c8ee8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:51.217251 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-bc70abc7-764b-4ae3-9347-11c3134d64fc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:51.225772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-bc70abc7-764b-4ae3-9347-11c3134d64fc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1567 microversion: 2.1 time: 0.231402 Jul 20 15:38:51.226391 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 378/767] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:50 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1567 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:38:51.280633 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-30ec5522-72d6-4eb2-b448-e8fbdf2c8ee8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:51.289756 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-30ec5522-72d6-4eb2-b448-e8fbdf2c8ee8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:51.291342 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-30ec5522-72d6-4eb2-b448-e8fbdf2c8ee8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:51.293020 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-30ec5522-72d6-4eb2-b448-e8fbdf2c8ee8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1738 microversion: 2.20 time: 0.213571 Jul 20 15:38:51.293575 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 390/768] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:51 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:38:51.425242 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-7982a13f-5131-4b25-997e-54c94c6f6b2e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:51.425833 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-7982a13f-5131-4b25-997e-54c94c6f6b2e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:51.431863 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7982a13f-5131-4b25-997e-54c94c6f6b2e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:51.439902 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7982a13f-5131-4b25-997e-54c94c6f6b2e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:51.439902 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7982a13f-5131-4b25-997e-54c94c6f6b2e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:51.439902 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7982a13f-5131-4b25-997e-54c94c6f6b2e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:51.462580 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-7982a13f-5131-4b25-997e-54c94c6f6b2e tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-volume_attachments/e0b329fd-1dea-4214-ab04-58d90c85d85e" status: 200 len: 194 microversion: 2.1 time: 0.041218 Jul 20 15:38:51.463165 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 379/769] 10.222.0.78 () {58 vars in 1412 bytes} [Wed Jul 20 15:38:51 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-volume_attachments/e0b329fd-1dea-4214-ab04-58d90c85d85e => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:38:51.473638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-604b7fa6-5bee-4abe-a5f8-7bb057b5224c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:51.474192 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-604b7fa6-5bee-4abe-a5f8-7bb057b5224c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:51.483133 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-604b7fa6-5bee-4abe-a5f8-7bb057b5224c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:51.483659 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-604b7fa6-5bee-4abe-a5f8-7bb057b5224c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:51.484506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-604b7fa6-5bee-4abe-a5f8-7bb057b5224c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:51.484944 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-604b7fa6-5bee-4abe-a5f8-7bb057b5224c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:51.570877 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.objects.instance [None req-604b7fa6-5bee-4abe-a5f8-7bb057b5224c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lazy-loading 'services' on Instance uuid a0f28926-7b36-49a2-bd27-7b7006fa992e {{(pid=124712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:38:51.857231 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-604b7fa6-5bee-4abe-a5f8-7bb057b5224c tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-volume_attachments/e0b329fd-1dea-4214-ab04-58d90c85d85e" status: 202 len: 0 microversion: 2.1 time: 0.387440 Jul 20 15:38:51.857859 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 391/770] 10.222.0.78 () {58 vars in 1415 bytes} [Wed Jul 20 15:38:51 2022] DELETE /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-volume_attachments/e0b329fd-1dea-4214-ab04-58d90c85d85e => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:38:52.244159 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e5afa533-31f2-4e09-b4a4-e272e77f91d1 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:52.246063 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e5afa533-31f2-4e09-b4a4-e272e77f91d1 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:52.253312 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e5afa533-31f2-4e09-b4a4-e272e77f91d1 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:52.254121 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e5afa533-31f2-4e09-b4a4-e272e77f91d1 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:52.255155 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e5afa533-31f2-4e09-b4a4-e272e77f91d1 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:52.255729 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e5afa533-31f2-4e09-b4a4-e272e77f91d1 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:52.313071 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-6c8c0e1f-ba9b-47b8-88c0-f8c0752d377e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:52.313491 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-6c8c0e1f-ba9b-47b8-88c0-f8c0752d377e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:52.328720 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6c8c0e1f-ba9b-47b8-88c0-f8c0752d377e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:52.329121 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6c8c0e1f-ba9b-47b8-88c0-f8c0752d377e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:52.333232 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6c8c0e1f-ba9b-47b8-88c0-f8c0752d377e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:52.333232 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6c8c0e1f-ba9b-47b8-88c0-f8c0752d377e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:52.519891 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e5afa533-31f2-4e09-b4a4-e272e77f91d1 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:52.538277 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e5afa533-31f2-4e09-b4a4-e272e77f91d1 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1567 microversion: 2.1 time: 0.297910 Jul 20 15:38:52.541009 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 380/771] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:52 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1567 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:38:52.561695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-6c8c0e1f-ba9b-47b8-88c0-f8c0752d377e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:52.570862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-6c8c0e1f-ba9b-47b8-88c0-f8c0752d377e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:52.572468 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-6c8c0e1f-ba9b-47b8-88c0-f8c0752d377e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:52.573868 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-6c8c0e1f-ba9b-47b8-88c0-f8c0752d377e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1738 microversion: 2.20 time: 0.266071 Jul 20 15:38:52.574657 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 392/772] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:52 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1738 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:38:53.046023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-6e4e5d46-9147-4eb7-b887-02b88bf89a34 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:53.047446 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-6e4e5d46-9147-4eb7-b887-02b88bf89a34 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:53.054092 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6e4e5d46-9147-4eb7-b887-02b88bf89a34 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:53.054570 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6e4e5d46-9147-4eb7-b887-02b88bf89a34 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:53.055351 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6e4e5d46-9147-4eb7-b887-02b88bf89a34 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:53.055790 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6e4e5d46-9147-4eb7-b887-02b88bf89a34 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:53.096005 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-6e4e5d46-9147-4eb7-b887-02b88bf89a34 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054355 Jul 20 15:38:53.102021 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 381/773] 10.222.0.78 () {58 vars in 1301 bytes} [Wed Jul 20 15:38:53 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 15:38:53.236405 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-6b267c24-4adb-42ed-a40d-01846cf46205 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:53.237510 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-6b267c24-4adb-42ed-a40d-01846cf46205 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:53.243759 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6b267c24-4adb-42ed-a40d-01846cf46205 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:53.244202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6b267c24-4adb-42ed-a40d-01846cf46205 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:53.245202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6b267c24-4adb-42ed-a40d-01846cf46205 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:53.245644 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6b267c24-4adb-42ed-a40d-01846cf46205 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:53.282030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-6b267c24-4adb-42ed-a40d-01846cf46205 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049563 Jul 20 15:38:53.285221 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 393/774] 10.222.0.78 () {58 vars in 1301 bytes} [Wed Jul 20 15:38:53 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 15:38:53.362097 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-592cdfa4-4e84-4d28-afc8-2ae8eb16fa76 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:53.372578 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-592cdfa4-4e84-4d28-afc8-2ae8eb16fa76 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:53.372578 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=50 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:53.372578 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-592cdfa4-4e84-4d28-afc8-2ae8eb16fa76 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:53.372578 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-592cdfa4-4e84-4d28-afc8-2ae8eb16fa76 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:53.373022 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-592cdfa4-4e84-4d28-afc8-2ae8eb16fa76 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:53.373022 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-592cdfa4-4e84-4d28-afc8-2ae8eb16fa76 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:53.400024 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-592cdfa4-4e84-4d28-afc8-2ae8eb16fa76 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Going to try to terminate instance {{(pid=124711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 15:38:53.560769 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-63d09993-a5dc-41c6-8075-854abbf74aca tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:53.561382 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-63d09993-a5dc-41c6-8075-854abbf74aca tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:53.572516 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-63d09993-a5dc-41c6-8075-854abbf74aca tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:53.573903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-63d09993-a5dc-41c6-8075-854abbf74aca tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:53.574970 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-63d09993-a5dc-41c6-8075-854abbf74aca tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:53.576036 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-63d09993-a5dc-41c6-8075-854abbf74aca tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:53.753585 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-63d09993-a5dc-41c6-8075-854abbf74aca tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:53.768606 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-63d09993-a5dc-41c6-8075-854abbf74aca tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1567 microversion: 2.1 time: 0.213738 Jul 20 15:38:53.769232 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 394/775] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:53 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:38:53.780460 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-4f7b2e34-1c92-48ca-87a7-30ec70313b07 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:53.781085 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-4f7b2e34-1c92-48ca-87a7-30ec70313b07 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:53.787364 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4f7b2e34-1c92-48ca-87a7-30ec70313b07 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:53.787803 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4f7b2e34-1c92-48ca-87a7-30ec70313b07 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:53.788557 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4f7b2e34-1c92-48ca-87a7-30ec70313b07 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:53.788999 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4f7b2e34-1c92-48ca-87a7-30ec70313b07 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:53.927835 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-592cdfa4-4e84-4d28-afc8-2ae8eb16fa76 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 204 len: 0 microversion: 2.1 time: 0.569390 Jul 20 15:38:53.928754 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 382/776] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:38:53 2022] DELETE /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 15:38:53.937463 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-2141943b-7e41-41e5-a487-8cd633995b80 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:53.946778 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-2141943b-7e41-41e5-a487-8cd633995b80 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:53.946778 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2141943b-7e41-41e5-a487-8cd633995b80 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:53.946778 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2141943b-7e41-41e5-a487-8cd633995b80 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:53.946778 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2141943b-7e41-41e5-a487-8cd633995b80 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:53.947173 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2141943b-7e41-41e5-a487-8cd633995b80 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:53.971577 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4f7b2e34-1c92-48ca-87a7-30ec70313b07 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:53.989169 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4f7b2e34-1c92-48ca-87a7-30ec70313b07 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:53.990734 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4f7b2e34-1c92-48ca-87a7-30ec70313b07 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:53.991917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-4f7b2e34-1c92-48ca-87a7-30ec70313b07 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1738 microversion: 2.20 time: 0.221754 Jul 20 15:38:53.992790 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 395/777] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:53 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:38:54.121950 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2141943b-7e41-41e5-a487-8cd633995b80 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:54.134188 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-2141943b-7e41-41e5-a487-8cd633995b80 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1673 microversion: 2.1 time: 0.200671 Jul 20 15:38:54.135119 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 383/778] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:53 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1673 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:38:54.786464 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-12db6b12-3425-4cab-9af0-6d1f7a58cbcc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:54.787129 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-12db6b12-3425-4cab-9af0-6d1f7a58cbcc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:54.794606 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-12db6b12-3425-4cab-9af0-6d1f7a58cbcc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:54.795050 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-12db6b12-3425-4cab-9af0-6d1f7a58cbcc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:54.795829 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-12db6b12-3425-4cab-9af0-6d1f7a58cbcc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:54.796299 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-12db6b12-3425-4cab-9af0-6d1f7a58cbcc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:54.935480 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-12db6b12-3425-4cab-9af0-6d1f7a58cbcc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:54.943495 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-12db6b12-3425-4cab-9af0-6d1f7a58cbcc tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1567 microversion: 2.1 time: 0.161298 Jul 20 15:38:54.944069 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 396/779] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:54 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:38:55.010648 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-236ab8a5-9478-4891-94be-e05af7b338e6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:55.011301 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-236ab8a5-9478-4891-94be-e05af7b338e6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:55.019111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-236ab8a5-9478-4891-94be-e05af7b338e6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:55.019634 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-236ab8a5-9478-4891-94be-e05af7b338e6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:55.020395 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-236ab8a5-9478-4891-94be-e05af7b338e6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:55.020833 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-236ab8a5-9478-4891-94be-e05af7b338e6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:55.159225 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-236ab8a5-9478-4891-94be-e05af7b338e6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:55.159483 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-4abc517f-409f-4420-bb4e-fb782d3971c7 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:55.160162 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-4abc517f-409f-4420-bb4e-fb782d3971c7 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:55.166317 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4abc517f-409f-4420-bb4e-fb782d3971c7 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:55.166837 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4abc517f-409f-4420-bb4e-fb782d3971c7 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:55.167727 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-236ab8a5-9478-4891-94be-e05af7b338e6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:55.168185 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4abc517f-409f-4420-bb4e-fb782d3971c7 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:55.168619 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4abc517f-409f-4420-bb4e-fb782d3971c7 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:55.169245 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-236ab8a5-9478-4891-94be-e05af7b338e6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:55.170445 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-236ab8a5-9478-4891-94be-e05af7b338e6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1738 microversion: 2.20 time: 0.163638 Jul 20 15:38:55.171064 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 384/780] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:55 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:38:55.307798 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4abc517f-409f-4420-bb4e-fb782d3971c7 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:55.315790 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-4abc517f-409f-4420-bb4e-fb782d3971c7 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1673 microversion: 2.1 time: 0.161238 Jul 20 15:38:55.316352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 397/781] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:55 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:38:55.969901 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-b3d8279c-7edc-4e8b-8e44-91660550a06b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:55.971247 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-b3d8279c-7edc-4e8b-8e44-91660550a06b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:55.979324 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b3d8279c-7edc-4e8b-8e44-91660550a06b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:55.980577 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b3d8279c-7edc-4e8b-8e44-91660550a06b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:55.981368 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b3d8279c-7edc-4e8b-8e44-91660550a06b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:55.981800 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b3d8279c-7edc-4e8b-8e44-91660550a06b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:56.189077 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-0d17f5a5-598e-4d79-83dc-600d86a27cf4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:56.190475 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-0d17f5a5-598e-4d79-83dc-600d86a27cf4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:56.197938 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0d17f5a5-598e-4d79-83dc-600d86a27cf4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:56.198915 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0d17f5a5-598e-4d79-83dc-600d86a27cf4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:56.199944 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0d17f5a5-598e-4d79-83dc-600d86a27cf4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:56.200628 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0d17f5a5-598e-4d79-83dc-600d86a27cf4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:56.332550 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-b3d8279c-7edc-4e8b-8e44-91660550a06b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:56.344972 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-b3d8279c-7edc-4e8b-8e44-91660550a06b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1567 microversion: 2.1 time: 0.387847 Jul 20 15:38:56.346452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 385/782] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:55 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1567 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:38:56.351383 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-bca362b4-2ecf-42b0-92ff-db3be5af0dbb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:56.352818 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-bca362b4-2ecf-42b0-92ff-db3be5af0dbb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:56.360964 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bca362b4-2ecf-42b0-92ff-db3be5af0dbb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:56.361751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bca362b4-2ecf-42b0-92ff-db3be5af0dbb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:56.364025 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bca362b4-2ecf-42b0-92ff-db3be5af0dbb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:56.364803 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bca362b4-2ecf-42b0-92ff-db3be5af0dbb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:56.373868 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:38:56.550066 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-0d17f5a5-598e-4d79-83dc-600d86a27cf4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:56.563712 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-0d17f5a5-598e-4d79-83dc-600d86a27cf4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:56.570938 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-0d17f5a5-598e-4d79-83dc-600d86a27cf4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:56.572843 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-0d17f5a5-598e-4d79-83dc-600d86a27cf4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1738 microversion: 2.20 time: 0.387502 Jul 20 15:38:56.574085 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 398/783] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:56 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1738 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:38:56.685360 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-bca362b4-2ecf-42b0-92ff-db3be5af0dbb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:56.696996 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-bca362b4-2ecf-42b0-92ff-db3be5af0dbb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1673 microversion: 2.1 time: 0.348751 Jul 20 15:38:56.701420 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 386/784] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:56 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1673 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:38:57.352225 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-41576889-8cd1-4e15-8137-1f0da98d9f71 req-778791c6-e10b-4709-87df-b2bb470ee7bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0f28926-7b36-49a2-bd27-7b7006fa992e", "name": "network-vif-deleted", "tag": "3aaaffa8-35ca-428a-a369-dca539b96513"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:38:57.363244 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d882ca18-ed1b-4eae-b791-1797c5a2b3b8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:57.364504 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-d882ca18-ed1b-4eae-b791-1797c5a2b3b8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:57.364855 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-41576889-8cd1-4e15-8137-1f0da98d9f71 req-778791c6-e10b-4709-87df-b2bb470ee7bd service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:57.365307 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-41576889-8cd1-4e15-8137-1f0da98d9f71 req-778791c6-e10b-4709-87df-b2bb470ee7bd service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:57.377808 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d882ca18-ed1b-4eae-b791-1797c5a2b3b8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:57.378564 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d882ca18-ed1b-4eae-b791-1797c5a2b3b8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:57.385485 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d882ca18-ed1b-4eae-b791-1797c5a2b3b8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:57.387579 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d882ca18-ed1b-4eae-b791-1797c5a2b3b8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:57.392741 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-41576889-8cd1-4e15-8137-1f0da98d9f71 req-778791c6-e10b-4709-87df-b2bb470ee7bd service nova] Creating event network-vif-deleted:3aaaffa8-35ca-428a-a369-dca539b96513 for instance a0f28926-7b36-49a2-bd27-7b7006fa992e on hv-cinder-81914 Jul 20 15:38:57.399770 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-41576889-8cd1-4e15-8137-1f0da98d9f71 req-778791c6-e10b-4709-87df-b2bb470ee7bd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058044 Jul 20 15:38:57.401536 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 399/785] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:38:57.598851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-7d1dd097-0993-4442-acf7-9ef6c9771acd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:57.598851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-7d1dd097-0993-4442-acf7-9ef6c9771acd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:57.617298 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7d1dd097-0993-4442-acf7-9ef6c9771acd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:57.618097 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7d1dd097-0993-4442-acf7-9ef6c9771acd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:57.619109 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7d1dd097-0993-4442-acf7-9ef6c9771acd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:57.619723 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7d1dd097-0993-4442-acf7-9ef6c9771acd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:57.638421 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d882ca18-ed1b-4eae-b791-1797c5a2b3b8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:57.649361 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d882ca18-ed1b-4eae-b791-1797c5a2b3b8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1567 microversion: 2.1 time: 0.290803 Jul 20 15:38:57.650230 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 387/786] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:57 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1567 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:38:57.717837 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ea0a7e71-ae14-4a4f-9aa3-198768f0a4a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:57.718801 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ea0a7e71-ae14-4a4f-9aa3-198768f0a4a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:57.729552 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ea0a7e71-ae14-4a4f-9aa3-198768f0a4a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:57.735243 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ea0a7e71-ae14-4a4f-9aa3-198768f0a4a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:57.744880 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ea0a7e71-ae14-4a4f-9aa3-198768f0a4a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:57.744880 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ea0a7e71-ae14-4a4f-9aa3-198768f0a4a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:57.795191 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ea0a7e71-ae14-4a4f-9aa3-198768f0a4a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:57.795191 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ea0a7e71-ae14-4a4f-9aa3-198768f0a4a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:57.795191 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.objects.instance [None req-ea0a7e71-ae14-4a4f-9aa3-198768f0a4a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lazy-loading 'fault' on Instance uuid a0f28926-7b36-49a2-bd27-7b7006fa992e {{(pid=124711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:38:57.809977 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-7d1dd097-0993-4442-acf7-9ef6c9771acd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:57.820394 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-7d1dd097-0993-4442-acf7-9ef6c9771acd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:57.822042 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-7d1dd097-0993-4442-acf7-9ef6c9771acd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:57.824000 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-7d1dd097-0993-4442-acf7-9ef6c9771acd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1738 microversion: 2.20 time: 0.235384 Jul 20 15:38:57.838553 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 400/787] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:57 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1738 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:38:57.861428 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-ea0a7e71-ae14-4a4f-9aa3-198768f0a4a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:57.871114 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-ea0a7e71-ae14-4a4f-9aa3-198768f0a4a8 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1326 microversion: 2.1 time: 0.157127 Jul 20 15:38:57.871807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 388/788] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:57 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1326 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:38:58.667259 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-886566d3-12e3-4dd3-8780-b7e5c9c0712a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:58.667887 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-886566d3-12e3-4dd3-8780-b7e5c9c0712a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:58.675699 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-886566d3-12e3-4dd3-8780-b7e5c9c0712a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:58.676198 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-886566d3-12e3-4dd3-8780-b7e5c9c0712a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:58.676991 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-886566d3-12e3-4dd3-8780-b7e5c9c0712a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:58.677438 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-886566d3-12e3-4dd3-8780-b7e5c9c0712a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:58.819579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-886566d3-12e3-4dd3-8780-b7e5c9c0712a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:58.827594 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-886566d3-12e3-4dd3-8780-b7e5c9c0712a tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1567 microversion: 2.1 time: 0.164414 Jul 20 15:38:58.828160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 401/789] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:58 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:38:58.845656 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-1078a96c-94d7-4994-98df-0cc405e27b00 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:58.846400 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-1078a96c-94d7-4994-98df-0cc405e27b00 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:58.853154 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1078a96c-94d7-4994-98df-0cc405e27b00 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:58.853619 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1078a96c-94d7-4994-98df-0cc405e27b00 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:58.854664 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1078a96c-94d7-4994-98df-0cc405e27b00 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:58.854959 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1078a96c-94d7-4994-98df-0cc405e27b00 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:58.896417 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d9656150-10cd-4874-8176-7c1551170d71 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:58.897100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d9656150-10cd-4874-8176-7c1551170d71 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:58.904138 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d9656150-10cd-4874-8176-7c1551170d71 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:58.904589 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d9656150-10cd-4874-8176-7c1551170d71 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:58.905357 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d9656150-10cd-4874-8176-7c1551170d71 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:58.915443 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d9656150-10cd-4874-8176-7c1551170d71 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:58.958455 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d9656150-10cd-4874-8176-7c1551170d71 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:58.959265 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d9656150-10cd-4874-8176-7c1551170d71 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:58.959672 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.objects.instance [None req-d9656150-10cd-4874-8176-7c1551170d71 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lazy-loading 'fault' on Instance uuid a0f28926-7b36-49a2-bd27-7b7006fa992e {{(pid=124712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:38:59.009216 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d9656150-10cd-4874-8176-7c1551170d71 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e75c180bae74be0b2ccad079f92d32b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa49d7002cf441348cf3166e64b1bc87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:59.017889 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-d9656150-10cd-4874-8176-7c1551170d71 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 200 len: 1326 microversion: 2.1 time: 0.125155 Jul 20 15:38:59.018776 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 402/790] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:58 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 1326 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:38:59.039446 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-1078a96c-94d7-4994-98df-0cc405e27b00 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:59.045163 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-1078a96c-94d7-4994-98df-0cc405e27b00 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:59.046695 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-1078a96c-94d7-4994-98df-0cc405e27b00 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:38:59.047852 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-1078a96c-94d7-4994-98df-0cc405e27b00 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1738 microversion: 2.20 time: 0.206340 Jul 20 15:38:59.048410 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 389/791] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:38:58 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1738 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:38:59.845607 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e15442bf-72a8-45f3-a456-4e9a72330210 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:38:59.846284 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e15442bf-72a8-45f3-a456-4e9a72330210 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:38:59.853063 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e15442bf-72a8-45f3-a456-4e9a72330210 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:59.853537 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e15442bf-72a8-45f3-a456-4e9a72330210 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:59.854394 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e15442bf-72a8-45f3-a456-4e9a72330210 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:38:59.855548 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e15442bf-72a8-45f3-a456-4e9a72330210 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:38:59.998245 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-e15442bf-72a8-45f3-a456-4e9a72330210 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:00.005649 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-e15442bf-72a8-45f3-a456-4e9a72330210 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1567 microversion: 2.1 time: 0.164002 Jul 20 15:39:00.006206 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 403/792] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:38:59 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:00.034949 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-73c09c45-0c9f-4d54-9395-8f390e7514ef tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:00.035848 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-73c09c45-0c9f-4d54-9395-8f390e7514ef tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:00.042528 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-73c09c45-0c9f-4d54-9395-8f390e7514ef tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:00.043115 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-73c09c45-0c9f-4d54-9395-8f390e7514ef tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:00.044004 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-73c09c45-0c9f-4d54-9395-8f390e7514ef tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:00.044444 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-73c09c45-0c9f-4d54-9395-8f390e7514ef tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:00.059971 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-73c09c45-0c9f-4d54-9395-8f390e7514ef tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] HTTP exception thrown: Instance a0f28926-7b36-49a2-bd27-7b7006fa992e could not be found. Jul 20 15:39:00.065398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-73c09c45-0c9f-4d54-9395-8f390e7514ef tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Request method failure captured: Jul 20 15:39:00.065398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e HTTP/1.1 Jul 20 15:39:00.065398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:39:00.065398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:39:00.065398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:39:00.065398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:39:00.065398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:39:00.065398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:39:00.065398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:39:00.065398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:39:00.065398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2B_nFuXYvlPrzYrTX8Q0s9aWu_-1pGR0bg32z749fIJLCJUTkGlaDTx5FkW0yG1uQes0XdtWNU-TVzz-t5ln2jKlua2Ul_rKyQ5Dy4IaYJXUbdlUz9W4TsuDc_u_W31MwuadvDauT2Fxiat4gefQ485mZJrDdkGpr34G9CIk5uIm500 Jul 20 15:39:00.065398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:39:00.065398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:39:00.065398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:39:00.065398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:39:00.065398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:39:00.065398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:39:00.065398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: aa49d7002cf441348cf3166e64b1bc87 Jul 20 15:39:00.065398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-AttachVolumeTestJSON-1914876992 Jul 20 15:39:00.065398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:39:00.065398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:39:00.067094 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa49d7002cf441348cf3166e64b1bc87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aa49d7002cf441348cf3166e64b1bc87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aa49d7002cf441348cf3166e64b1bc87", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa49d7002cf441348cf3166e64b1bc87"}]}] Jul 20 15:39:00.067094 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-AttachVolumeTestJSON-1914876992 Jul 20 15:39:00.067094 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: aa49d7002cf441348cf3166e64b1bc87 Jul 20 15:39:00.067094 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1914876992 Jul 20 15:39:00.067094 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-AttachVolumeTestJSON-1914876992-project Jul 20 15:39:00.067094 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:39:00.067094 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:39:00.067094 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: 8e75c180bae74be0b2ccad079f92d32b Jul 20 15:39:00.067094 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-AttachVolumeTestJSON-1914876992-project Jul 20 15:39:00.067094 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: > Jul 20 15:39:00.067094 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Instance a0f28926-7b36-49a2-bd27-7b7006fa992e could not be found. Jul 20 15:39:00.067094 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': 'a0f28926-7b36-49a2-bd27-7b7006fa992e'} Jul 20 15:39:00.068641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:39:00.068641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:39:00.068641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:39:00.068641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:39:00.068641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:39:00.068641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:39:00.068641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:39:00.068641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:39:00.068641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:39:00.068641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:39:00.068641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0f28926-7b36-49a2-bd27-7b7006fa992e could not be found. Jul 20 15:39:00.068641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:00.068641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:39:00.068641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:00.068641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:39:00.068641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:39:00.068641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:39:00.068641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:39:00.068641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:39:00.068641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:39:00.071410 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:39:00.071410 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:39:00.071410 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:39:00.071410 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:39:00.071410 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:39:00.071410 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:39:00.071410 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:39:00.071410 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0f28926-7b36-49a2-bd27-7b7006fa992e could not be found. Jul 20 15:39:00.071410 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:00.071410 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:39:00.071410 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:00.071410 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:39:00.071410 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:39:00.071410 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:39:00.071410 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:39:00.071410 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:39:00.071410 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0f28926-7b36-49a2-bd27-7b7006fa992e could not be found. Jul 20 15:39:00.071410 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:00.074002 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-73c09c45-0c9f-4d54-9395-8f390e7514ef tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Returning 404 to user: Instance a0f28926-7b36-49a2-bd27-7b7006fa992e could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:39:00.074002 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-73c09c45-0c9f-4d54-9395-8f390e7514ef tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 404 len: 111 microversion: 2.1 time: 0.036028 Jul 20 15:39:00.074308 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-34908296-7526-4c8e-96af-48424109d03d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:00.074473 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 390/793] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:00 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:39:00.074617 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-34908296-7526-4c8e-96af-48424109d03d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:00.074991 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-34908296-7526-4c8e-96af-48424109d03d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:00.075441 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-34908296-7526-4c8e-96af-48424109d03d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:00.075595 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-1bb85216-5d2e-4944-84e8-d253fd4e5393 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '.version_select at 0x7efd90a53670>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:00.076733 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-34908296-7526-4c8e-96af-48424109d03d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:00.076920 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-34908296-7526-4c8e-96af-48424109d03d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:00.192205 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-1bb85216-5d2e-4944-84e8-d253fd4e5393 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-165168349" status: 202 len: 0 microversion: 2.1 time: 0.120236 Jul 20 15:39:00.194773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 391/794] 10.222.0.78 () {58 vars in 1217 bytes} [Wed Jul 20 15:39:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-165168349 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 15:39:00.216932 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-34908296-7526-4c8e-96af-48424109d03d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:00.225571 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-34908296-7526-4c8e-96af-48424109d03d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:00.227089 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-34908296-7526-4c8e-96af-48424109d03d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:00.228242 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-34908296-7526-4c8e-96af-48424109d03d tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1738 microversion: 2.20 time: 0.165509 Jul 20 15:39:00.228799 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 404/795] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:00 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:39:01.022956 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-b07f81d4-7581-4c39-85ae-9a143c5daf18 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:01.023566 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-b07f81d4-7581-4c39-85ae-9a143c5daf18 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:01.032757 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b07f81d4-7581-4c39-85ae-9a143c5daf18 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:01.033209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b07f81d4-7581-4c39-85ae-9a143c5daf18 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:01.033986 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b07f81d4-7581-4c39-85ae-9a143c5daf18 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:01.034462 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b07f81d4-7581-4c39-85ae-9a143c5daf18 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:01.193492 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-b07f81d4-7581-4c39-85ae-9a143c5daf18 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:01.202386 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-b07f81d4-7581-4c39-85ae-9a143c5daf18 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1567 microversion: 2.1 time: 0.183400 Jul 20 15:39:01.203258 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 392/796] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:01 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:01.223605 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-311b8196-5273-45b6-b566-e8d88ff46bfc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:01.224780 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-311b8196-5273-45b6-b566-e8d88ff46bfc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:01.231284 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-311b8196-5273-45b6-b566-e8d88ff46bfc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:01.231757 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-311b8196-5273-45b6-b566-e8d88ff46bfc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:01.232513 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-311b8196-5273-45b6-b566-e8d88ff46bfc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:01.232937 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-311b8196-5273-45b6-b566-e8d88ff46bfc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:01.253457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-7e34978f-8145-4800-95b8-42eb7de03f5e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:01.253457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-7e34978f-8145-4800-95b8-42eb7de03f5e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:01.256922 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7e34978f-8145-4800-95b8-42eb7de03f5e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:01.257427 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7e34978f-8145-4800-95b8-42eb7de03f5e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:01.258190 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7e34978f-8145-4800-95b8-42eb7de03f5e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:01.258503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-311b8196-5273-45b6-b566-e8d88ff46bfc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc/ips" status: 200 len: 150 microversion: 2.1 time: 0.038690 Jul 20 15:39:01.259084 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7e34978f-8145-4800-95b8-42eb7de03f5e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:01.259200 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 405/797] 10.222.0.78 () {58 vars in 1247 bytes} [Wed Jul 20 15:39:01 2022] GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:39:01.476343 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-7e34978f-8145-4800-95b8-42eb7de03f5e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:01.485162 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-7e34978f-8145-4800-95b8-42eb7de03f5e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:01.486930 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-7e34978f-8145-4800-95b8-42eb7de03f5e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:01.487967 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-7e34978f-8145-4800-95b8-42eb7de03f5e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1720 microversion: 2.20 time: 0.244509 Jul 20 15:39:01.488782 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 393/798] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:01 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1720 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:39:02.220360 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d4c00e18-eebd-4c47-9085-8f729b2d3bad tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:02.220974 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d4c00e18-eebd-4c47-9085-8f729b2d3bad tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:02.228268 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d4c00e18-eebd-4c47-9085-8f729b2d3bad tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:02.228869 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d4c00e18-eebd-4c47-9085-8f729b2d3bad tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:02.229466 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d4c00e18-eebd-4c47-9085-8f729b2d3bad tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:02.229896 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d4c00e18-eebd-4c47-9085-8f729b2d3bad tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:02.232873 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=98 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:02.370966 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d4c00e18-eebd-4c47-9085-8f729b2d3bad tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:02.378881 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-d4c00e18-eebd-4c47-9085-8f729b2d3bad tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1567 microversion: 2.1 time: 0.162249 Jul 20 15:39:02.379396 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 406/799] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:02 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:02.507080 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-8aac57b1-e87d-4e10-9976-215bb210ac67 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:02.507767 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-8aac57b1-e87d-4e10-9976-215bb210ac67 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:02.514279 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8aac57b1-e87d-4e10-9976-215bb210ac67 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:02.514768 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8aac57b1-e87d-4e10-9976-215bb210ac67 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:02.515532 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8aac57b1-e87d-4e10-9976-215bb210ac67 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:02.515967 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8aac57b1-e87d-4e10-9976-215bb210ac67 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:02.648967 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-8aac57b1-e87d-4e10-9976-215bb210ac67 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:02.657439 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-8aac57b1-e87d-4e10-9976-215bb210ac67 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:02.659005 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-8aac57b1-e87d-4e10-9976-215bb210ac67 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:02.660246 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-8aac57b1-e87d-4e10-9976-215bb210ac67 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1720 microversion: 2.20 time: 0.157014 Jul 20 15:39:02.660733 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 394/800] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:02 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:39:03.242178 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b0ce9784-9314-45ec-b4d9-8bf6f95a4110 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df057e20-4c8a-4c1e-a088-bf16eda0c826"}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:39:03.243295 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b0ce9784-9314-45ec-b4d9-8bf6f95a4110 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:03.250756 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b0ce9784-9314-45ec-b4d9-8bf6f95a4110 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:03.251196 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b0ce9784-9314-45ec-b4d9-8bf6f95a4110 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:03.251941 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b0ce9784-9314-45ec-b4d9-8bf6f95a4110 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:03.252364 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b0ce9784-9314-45ec-b4d9-8bf6f95a4110 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:03.396091 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-953b6dc3-8240-4c9d-9494-6d5f79655ccf tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:03.397766 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-953b6dc3-8240-4c9d-9494-6d5f79655ccf tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:03.404343 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-953b6dc3-8240-4c9d-9494-6d5f79655ccf tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:03.405131 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-953b6dc3-8240-4c9d-9494-6d5f79655ccf tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:03.405567 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-953b6dc3-8240-4c9d-9494-6d5f79655ccf tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:03.406004 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-953b6dc3-8240-4c9d-9494-6d5f79655ccf tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:03.575566 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-953b6dc3-8240-4c9d-9494-6d5f79655ccf tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:03.584434 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-953b6dc3-8240-4c9d-9494-6d5f79655ccf tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1567 microversion: 2.1 time: 0.192299 Jul 20 15:39:03.585018 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 395/801] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:03 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:39:03.678498 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-9b49b759-88ad-4709-8b3c-1a365799b6b8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:03.679101 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-9b49b759-88ad-4709-8b3c-1a365799b6b8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:03.686565 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9b49b759-88ad-4709-8b3c-1a365799b6b8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:03.687061 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9b49b759-88ad-4709-8b3c-1a365799b6b8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:03.687999 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9b49b759-88ad-4709-8b3c-1a365799b6b8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:03.688436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9b49b759-88ad-4709-8b3c-1a365799b6b8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:03.838869 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-9b49b759-88ad-4709-8b3c-1a365799b6b8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:03.847562 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-9b49b759-88ad-4709-8b3c-1a365799b6b8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:03.849083 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-9b49b759-88ad-4709-8b3c-1a365799b6b8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:03.851836 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-9b49b759-88ad-4709-8b3c-1a365799b6b8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1720 microversion: 2.20 time: 0.175838 Jul 20 15:39:03.851836 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 396/802] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:03 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:39:03.855928 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-913f61ea-9bd9-488d-b4d1-69545443e0ed tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:03.856425 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-913f61ea-9bd9-488d-b4d1-69545443e0ed tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:03.862999 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-913f61ea-9bd9-488d-b4d1-69545443e0ed tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:03.863448 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-913f61ea-9bd9-488d-b4d1-69545443e0ed tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:03.864246 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-913f61ea-9bd9-488d-b4d1-69545443e0ed tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:03.864684 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-913f61ea-9bd9-488d-b4d1-69545443e0ed tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:03.881481 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-913f61ea-9bd9-488d-b4d1-69545443e0ed tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] HTTP exception thrown: Instance a0f28926-7b36-49a2-bd27-7b7006fa992e could not be found. Jul 20 15:39:03.883452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-913f61ea-9bd9-488d-b4d1-69545443e0ed tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Request method failure captured: Jul 20 15:39:03.883452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: DELETE /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e HTTP/1.1 Jul 20 15:39:03.883452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:39:03.883452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:39:03.883452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:39:03.883452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:39:03.883452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:39:03.883452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:39:03.883452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:39:03.883452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:39:03.883452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2B_nFuXYvlPrzYrTX8Q0s9aWu_-1pGR0bg32z749fIJLCJUTkGlaDTx5FkW0yG1uQes0XdtWNU-TVzz-t5ln2jKlua2Ul_rKyQ5Dy4IaYJXUbdlUz9W4TsuDc_u_W31MwuadvDauT2Fxiat4gefQ485mZJrDdkGpr34G9CIk5uIm500 Jul 20 15:39:03.883452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:39:03.883452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:39:03.883452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:39:03.883452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:39:03.883452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:39:03.883452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:39:03.883452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: aa49d7002cf441348cf3166e64b1bc87 Jul 20 15:39:03.883452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-AttachVolumeTestJSON-1914876992 Jul 20 15:39:03.883452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:39:03.883452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:39:03.885026 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa49d7002cf441348cf3166e64b1bc87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aa49d7002cf441348cf3166e64b1bc87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aa49d7002cf441348cf3166e64b1bc87", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa49d7002cf441348cf3166e64b1bc87"}]}] Jul 20 15:39:03.885026 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-AttachVolumeTestJSON-1914876992 Jul 20 15:39:03.885026 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: aa49d7002cf441348cf3166e64b1bc87 Jul 20 15:39:03.885026 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1914876992 Jul 20 15:39:03.885026 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-AttachVolumeTestJSON-1914876992-project Jul 20 15:39:03.885026 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:39:03.885026 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:39:03.885026 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: 8e75c180bae74be0b2ccad079f92d32b Jul 20 15:39:03.885026 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-AttachVolumeTestJSON-1914876992-project Jul 20 15:39:03.885026 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: > Jul 20 15:39:03.885026 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Instance a0f28926-7b36-49a2-bd27-7b7006fa992e could not be found. Jul 20 15:39:03.885026 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': 'a0f28926-7b36-49a2-bd27-7b7006fa992e'} Jul 20 15:39:03.886633 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:39:03.886633 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:39:03.886633 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:39:03.886633 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:39:03.886633 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:39:03.886633 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:39:03.886633 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:39:03.886633 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:39:03.886633 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:39:03.886633 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:39:03.886633 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0f28926-7b36-49a2-bd27-7b7006fa992e could not be found. Jul 20 15:39:03.886633 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:03.886633 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:39:03.886633 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:03.886633 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:39:03.886633 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:39:03.886633 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:39:03.886633 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:39:03.886633 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:39:03.886633 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:39:03.889363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:39:03.889363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 15:39:03.889363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 15:39:03.889363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 15:39:03.889363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 15:39:03.889363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:39:03.889363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:39:03.889363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:39:03.889363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:39:03.889363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0f28926-7b36-49a2-bd27-7b7006fa992e could not be found. Jul 20 15:39:03.889363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:03.889363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:39:03.889363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:03.889363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:39:03.889363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:39:03.889363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:39:03.889363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:39:03.889363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:39:03.889363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0f28926-7b36-49a2-bd27-7b7006fa992e could not be found. Jul 20 15:39:03.889363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:03.892032 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-913f61ea-9bd9-488d-b4d1-69545443e0ed tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Returning 404 to user: Instance a0f28926-7b36-49a2-bd27-7b7006fa992e could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:39:03.892032 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-913f61ea-9bd9-488d-b4d1-69545443e0ed tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 404 len: 111 microversion: 2.1 time: 0.033014 Jul 20 15:39:03.892032 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 397/803] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:39:03 2022] DELETE /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:39:03.895139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-a4a0b5b9-64a2-4c1d-82b3-24f857cee7cb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:03.895759 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-a4a0b5b9-64a2-4c1d-82b3-24f857cee7cb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: a0f28926-7b36-49a2-bd27-7b7006fa992e] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:03.903333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a4a0b5b9-64a2-4c1d-82b3-24f857cee7cb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:03.903782 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a4a0b5b9-64a2-4c1d-82b3-24f857cee7cb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:03.904558 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a4a0b5b9-64a2-4c1d-82b3-24f857cee7cb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:03.904992 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a4a0b5b9-64a2-4c1d-82b3-24f857cee7cb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:03.919498 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-a4a0b5b9-64a2-4c1d-82b3-24f857cee7cb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] HTTP exception thrown: Instance a0f28926-7b36-49a2-bd27-7b7006fa992e could not be found. Jul 20 15:39:03.921239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-a4a0b5b9-64a2-4c1d-82b3-24f857cee7cb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Request method failure captured: Jul 20 15:39:03.921239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e HTTP/1.1 Jul 20 15:39:03.921239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:39:03.921239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:39:03.921239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:39:03.921239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:39:03.921239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:39:03.921239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:39:03.921239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:39:03.921239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:39:03.921239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2B_nFuXYvlPrzYrTX8Q0s9aWu_-1pGR0bg32z749fIJLCJUTkGlaDTx5FkW0yG1uQes0XdtWNU-TVzz-t5ln2jKlua2Ul_rKyQ5Dy4IaYJXUbdlUz9W4TsuDc_u_W31MwuadvDauT2Fxiat4gefQ485mZJrDdkGpr34G9CIk5uIm500 Jul 20 15:39:03.921239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:39:03.921239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:39:03.921239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:39:03.921239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:39:03.921239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:39:03.921239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:39:03.921239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: aa49d7002cf441348cf3166e64b1bc87 Jul 20 15:39:03.921239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-AttachVolumeTestJSON-1914876992 Jul 20 15:39:03.921239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:39:03.921239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:39:03.922945 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa49d7002cf441348cf3166e64b1bc87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aa49d7002cf441348cf3166e64b1bc87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aa49d7002cf441348cf3166e64b1bc87", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa49d7002cf441348cf3166e64b1bc87"}]}] Jul 20 15:39:03.922945 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-AttachVolumeTestJSON-1914876992 Jul 20 15:39:03.922945 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: aa49d7002cf441348cf3166e64b1bc87 Jul 20 15:39:03.922945 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1914876992 Jul 20 15:39:03.922945 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-AttachVolumeTestJSON-1914876992-project Jul 20 15:39:03.922945 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:39:03.922945 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:39:03.922945 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: 8e75c180bae74be0b2ccad079f92d32b Jul 20 15:39:03.922945 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-AttachVolumeTestJSON-1914876992-project Jul 20 15:39:03.922945 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: > Jul 20 15:39:03.922945 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Instance a0f28926-7b36-49a2-bd27-7b7006fa992e could not be found. Jul 20 15:39:03.922945 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': 'a0f28926-7b36-49a2-bd27-7b7006fa992e'} Jul 20 15:39:03.923955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:39:03.923955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:39:03.923955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:39:03.923955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:39:03.923955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:39:03.923955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:39:03.923955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:39:03.923955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:39:03.923955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:39:03.923955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:39:03.923955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0f28926-7b36-49a2-bd27-7b7006fa992e could not be found. Jul 20 15:39:03.923955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:03.923955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:39:03.923955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:03.923955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:39:03.923955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:39:03.923955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:39:03.923955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:39:03.923955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:39:03.923955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:39:03.925605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:39:03.925605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:39:03.925605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:39:03.925605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:39:03.925605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:39:03.925605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:39:03.925605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:39:03.925605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0f28926-7b36-49a2-bd27-7b7006fa992e could not be found. Jul 20 15:39:03.925605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:03.925605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:39:03.925605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:03.925605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:39:03.925605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:39:03.925605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:39:03.925605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:39:03.925605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:39:03.925605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0f28926-7b36-49a2-bd27-7b7006fa992e could not be found. Jul 20 15:39:03.925605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:03.927020 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-a4a0b5b9-64a2-4c1d-82b3-24f857cee7cb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Returning 404 to user: Instance a0f28926-7b36-49a2-bd27-7b7006fa992e could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:39:03.927020 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-a4a0b5b9-64a2-4c1d-82b3-24f857cee7cb tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e" status: 404 len: 111 microversion: 2.1 time: 0.031208 Jul 20 15:39:03.927020 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 398/804] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:03 2022] GET /compute/v2.1/servers/a0f28926-7b36-49a2-bd27-7b7006fa992e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 15:39:04.601369 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-535a2f6e-ba62-45ce-b952-6558cad58a30 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:04.602065 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-535a2f6e-ba62-45ce-b952-6558cad58a30 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:04.609377 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-535a2f6e-ba62-45ce-b952-6558cad58a30 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:04.609828 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-535a2f6e-ba62-45ce-b952-6558cad58a30 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:04.610635 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-535a2f6e-ba62-45ce-b952-6558cad58a30 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:04.611073 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-535a2f6e-ba62-45ce-b952-6558cad58a30 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:04.757012 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-535a2f6e-ba62-45ce-b952-6558cad58a30 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:04.766621 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-535a2f6e-ba62-45ce-b952-6558cad58a30 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1567 microversion: 2.1 time: 0.169097 Jul 20 15:39:04.767280 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 399/805] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:04 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:39:04.870640 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-cf9b920c-fe0a-46ba-9bed-4d732663e8a3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:04.871170 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-cf9b920c-fe0a-46ba-9bed-4d732663e8a3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:04.877855 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cf9b920c-fe0a-46ba-9bed-4d732663e8a3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:04.878334 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cf9b920c-fe0a-46ba-9bed-4d732663e8a3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:04.881342 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cf9b920c-fe0a-46ba-9bed-4d732663e8a3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:04.881342 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cf9b920c-fe0a-46ba-9bed-4d732663e8a3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:05.024814 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-cf9b920c-fe0a-46ba-9bed-4d732663e8a3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:05.032786 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-cf9b920c-fe0a-46ba-9bed-4d732663e8a3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:05.034342 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-cf9b920c-fe0a-46ba-9bed-4d732663e8a3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:05.035487 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-cf9b920c-fe0a-46ba-9bed-4d732663e8a3 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1720 microversion: 2.20 time: 0.168942 Jul 20 15:39:05.036041 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 400/806] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:04 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:39:05.213138 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-25d6640d-8d76-4f32-81bb-8512ff8cdcd9 req-da71410f-d378-4e7a-9d50-53e2562be573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1f04603-2085-4cc0-8263-d9c95c31f8a7", "name": "network-vif-unplugged", "status": "completed", "tag": "a14d5f16-fe56-45ba-b07b-4affc5762962"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:39:05.222044 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-25d6640d-8d76-4f32-81bb-8512ff8cdcd9 req-da71410f-d378-4e7a-9d50-53e2562be573 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:05.222510 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-25d6640d-8d76-4f32-81bb-8512ff8cdcd9 req-da71410f-d378-4e7a-9d50-53e2562be573 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:05.234791 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-25d6640d-8d76-4f32-81bb-8512ff8cdcd9 req-da71410f-d378-4e7a-9d50-53e2562be573 service nova] Creating event network-vif-unplugged:a14d5f16-fe56-45ba-b07b-4affc5762962 for instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 on hv-cinder-81914 Jul 20 15:39:05.239759 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-25d6640d-8d76-4f32-81bb-8512ff8cdcd9 req-da71410f-d378-4e7a-9d50-53e2562be573 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030698 Jul 20 15:39:05.240346 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 401/807] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:39:05.502156 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-b554afec-2b83-44b9-bb28-bf31f74ca3c9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:05.502864 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-b554afec-2b83-44b9-bb28-bf31f74ca3c9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:05.509636 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b554afec-2b83-44b9-bb28-bf31f74ca3c9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:05.510096 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b554afec-2b83-44b9-bb28-bf31f74ca3c9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:05.510924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b554afec-2b83-44b9-bb28-bf31f74ca3c9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:05.511363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-b554afec-2b83-44b9-bb28-bf31f74ca3c9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:05.525659 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-b554afec-2b83-44b9-bb28-bf31f74ca3c9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] HTTP exception thrown: Instance 7693c05d-ad3d-40fb-8c50-56e655ca708a could not be found. Jul 20 15:39:05.527415 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-b554afec-2b83-44b9-bb28-bf31f74ca3c9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Request method failure captured: Jul 20 15:39:05.527415 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: DELETE /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a HTTP/1.1 Jul 20 15:39:05.527415 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:39:05.527415 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:39:05.527415 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:39:05.527415 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:39:05.527415 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:39:05.527415 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:39:05.527415 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:39:05.527415 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:39:05.527415 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2B_nFuXYvlPrzYrTX8Q0s9aWu_-1pGR0bg32z749fIJLCJUTkGlaDTx5FkW0yG1uQes0XdtWNU-TVzz-t5ln2jKlua2Ul_rKyQ5Dy4IaYJXUbdlUz9W4TsuDc_u_W31MwuadvDauT2Fxiat4gefQ485mZJrDdkGpr34G9CIk5uIm500 Jul 20 15:39:05.527415 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:39:05.527415 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:39:05.527415 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:39:05.527415 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:39:05.527415 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:39:05.527415 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:39:05.527415 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: aa49d7002cf441348cf3166e64b1bc87 Jul 20 15:39:05.527415 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-AttachVolumeTestJSON-1914876992 Jul 20 15:39:05.527415 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:39:05.527415 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:39:05.529079 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa49d7002cf441348cf3166e64b1bc87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aa49d7002cf441348cf3166e64b1bc87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aa49d7002cf441348cf3166e64b1bc87", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa49d7002cf441348cf3166e64b1bc87"}]}] Jul 20 15:39:05.529079 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-AttachVolumeTestJSON-1914876992 Jul 20 15:39:05.529079 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: aa49d7002cf441348cf3166e64b1bc87 Jul 20 15:39:05.529079 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1914876992 Jul 20 15:39:05.529079 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-AttachVolumeTestJSON-1914876992-project Jul 20 15:39:05.529079 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:39:05.529079 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:39:05.529079 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: 8e75c180bae74be0b2ccad079f92d32b Jul 20 15:39:05.529079 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-AttachVolumeTestJSON-1914876992-project Jul 20 15:39:05.529079 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: > Jul 20 15:39:05.529079 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Instance 7693c05d-ad3d-40fb-8c50-56e655ca708a could not be found. Jul 20 15:39:05.529079 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': '7693c05d-ad3d-40fb-8c50-56e655ca708a'} Jul 20 15:39:05.529916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:39:05.529916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:39:05.529916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:39:05.529916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:39:05.529916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:39:05.529916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:39:05.529916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:39:05.529916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:39:05.529916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:39:05.529916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:39:05.529916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7693c05d-ad3d-40fb-8c50-56e655ca708a could not be found. Jul 20 15:39:05.529916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:05.529916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:39:05.529916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:05.529916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:39:05.529916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:39:05.529916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:39:05.529916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:39:05.529916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:39:05.529916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:39:05.531526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:39:05.531526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 15:39:05.531526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 15:39:05.531526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 15:39:05.531526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 15:39:05.531526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:39:05.531526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:39:05.531526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:39:05.531526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:39:05.531526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7693c05d-ad3d-40fb-8c50-56e655ca708a could not be found. Jul 20 15:39:05.531526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:05.531526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:39:05.531526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:05.531526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:39:05.531526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:39:05.531526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:39:05.531526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:39:05.531526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:39:05.531526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7693c05d-ad3d-40fb-8c50-56e655ca708a could not be found. Jul 20 15:39:05.531526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:05.533053 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-b554afec-2b83-44b9-bb28-bf31f74ca3c9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Returning 404 to user: Instance 7693c05d-ad3d-40fb-8c50-56e655ca708a could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:39:05.533053 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-b554afec-2b83-44b9-bb28-bf31f74ca3c9 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 404 len: 111 microversion: 2.1 time: 0.031429 Jul 20 15:39:05.533053 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 402/808] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:39:05 2022] DELETE /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 15:39:05.537464 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-9215ec6a-22d0-4ad5-97a0-2ec877d80e11 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:05.538070 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-9215ec6a-22d0-4ad5-97a0-2ec877d80e11 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] [instance: 7693c05d-ad3d-40fb-8c50-56e655ca708a] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:05.544614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9215ec6a-22d0-4ad5-97a0-2ec877d80e11 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:05.545058 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9215ec6a-22d0-4ad5-97a0-2ec877d80e11 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:05.545815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9215ec6a-22d0-4ad5-97a0-2ec877d80e11 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:05.546358 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9215ec6a-22d0-4ad5-97a0-2ec877d80e11 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:05.560052 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-9215ec6a-22d0-4ad5-97a0-2ec877d80e11 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] HTTP exception thrown: Instance 7693c05d-ad3d-40fb-8c50-56e655ca708a could not be found. Jul 20 15:39:05.562054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-9215ec6a-22d0-4ad5-97a0-2ec877d80e11 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Request method failure captured: Jul 20 15:39:05.562054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a HTTP/1.1 Jul 20 15:39:05.562054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:39:05.562054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:39:05.562054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:39:05.562054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:39:05.562054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:39:05.562054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:39:05.562054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:39:05.562054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:39:05.562054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2B_nFuXYvlPrzYrTX8Q0s9aWu_-1pGR0bg32z749fIJLCJUTkGlaDTx5FkW0yG1uQes0XdtWNU-TVzz-t5ln2jKlua2Ul_rKyQ5Dy4IaYJXUbdlUz9W4TsuDc_u_W31MwuadvDauT2Fxiat4gefQ485mZJrDdkGpr34G9CIk5uIm500 Jul 20 15:39:05.562054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:39:05.562054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:39:05.562054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:39:05.562054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:39:05.562054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:39:05.562054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:39:05.562054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: aa49d7002cf441348cf3166e64b1bc87 Jul 20 15:39:05.562054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-AttachVolumeTestJSON-1914876992 Jul 20 15:39:05.562054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:39:05.562054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:39:05.563965 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa49d7002cf441348cf3166e64b1bc87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aa49d7002cf441348cf3166e64b1bc87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aa49d7002cf441348cf3166e64b1bc87", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa49d7002cf441348cf3166e64b1bc87"}]}] Jul 20 15:39:05.563965 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-AttachVolumeTestJSON-1914876992 Jul 20 15:39:05.563965 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: aa49d7002cf441348cf3166e64b1bc87 Jul 20 15:39:05.563965 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1914876992 Jul 20 15:39:05.563965 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-AttachVolumeTestJSON-1914876992-project Jul 20 15:39:05.563965 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:39:05.563965 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:39:05.563965 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: 8e75c180bae74be0b2ccad079f92d32b Jul 20 15:39:05.563965 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-AttachVolumeTestJSON-1914876992-project Jul 20 15:39:05.563965 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: > Jul 20 15:39:05.563965 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Instance 7693c05d-ad3d-40fb-8c50-56e655ca708a could not be found. Jul 20 15:39:05.563965 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': '7693c05d-ad3d-40fb-8c50-56e655ca708a'} Jul 20 15:39:05.564796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:39:05.564796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:39:05.564796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:39:05.564796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:39:05.564796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:39:05.564796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:39:05.564796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:39:05.564796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:39:05.564796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:39:05.564796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:39:05.564796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7693c05d-ad3d-40fb-8c50-56e655ca708a could not be found. Jul 20 15:39:05.564796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:05.564796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:39:05.564796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:05.564796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:39:05.564796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:39:05.564796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:39:05.564796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:39:05.564796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:39:05.564796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:39:05.566226 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:39:05.566226 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:39:05.566226 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:39:05.566226 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:39:05.566226 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:39:05.566226 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:39:05.566226 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:39:05.566226 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7693c05d-ad3d-40fb-8c50-56e655ca708a could not be found. Jul 20 15:39:05.566226 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:05.566226 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:39:05.566226 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:05.566226 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:39:05.566226 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:39:05.566226 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:39:05.566226 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:39:05.566226 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:39:05.566226 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7693c05d-ad3d-40fb-8c50-56e655ca708a could not be found. Jul 20 15:39:05.566226 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:39:05.567559 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-9215ec6a-22d0-4ad5-97a0-2ec877d80e11 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] Returning 404 to user: Instance 7693c05d-ad3d-40fb-8c50-56e655ca708a could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:39:05.567559 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-9215ec6a-22d0-4ad5-97a0-2ec877d80e11 tempest-AttachVolumeTestJSON-1914876992 tempest-AttachVolumeTestJSON-1914876992-project] 10.222.0.78 "GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a" status: 404 len: 111 microversion: 2.1 time: 0.029811 Jul 20 15:39:05.567559 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 403/809] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:05 2022] GET /compute/v2.1/servers/7693c05d-ad3d-40fb-8c50-56e655ca708a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 15:39:05.784885 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e38d27c2-2458-4bfc-b9c9-4147112d9ddb tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:05.785553 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e38d27c2-2458-4bfc-b9c9-4147112d9ddb tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:05.792850 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e38d27c2-2458-4bfc-b9c9-4147112d9ddb tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:05.793321 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e38d27c2-2458-4bfc-b9c9-4147112d9ddb tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:05.794108 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e38d27c2-2458-4bfc-b9c9-4147112d9ddb tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:05.794615 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e38d27c2-2458-4bfc-b9c9-4147112d9ddb tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:05.943070 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b0ce9784-9314-45ec-b4d9-8bf6f95a4110 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "POST /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.704967 Jul 20 15:39:05.944029 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 407/810] 10.222.0.78 () {60 vars in 1322 bytes} [Wed Jul 20 15:39:03 2022] POST /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc/os-volume_attachments => generated 194 bytes in 2707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:39:06.060293 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-a8805bbb-8d56-4537-b931-1018de0056c4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:06.061030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-a8805bbb-8d56-4537-b931-1018de0056c4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:06.063250 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=60 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:06.069176 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a8805bbb-8d56-4537-b931-1018de0056c4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:06.069706 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a8805bbb-8d56-4537-b931-1018de0056c4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:06.070635 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a8805bbb-8d56-4537-b931-1018de0056c4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:06.071089 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a8805bbb-8d56-4537-b931-1018de0056c4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:06.359619 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e38d27c2-2458-4bfc-b9c9-4147112d9ddb tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:06.367274 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e38d27c2-2458-4bfc-b9c9-4147112d9ddb tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1567 microversion: 2.1 time: 0.586350 Jul 20 15:39:06.367935 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 404/811] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:05 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1567 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:39:06.406406 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-a8805bbb-8d56-4537-b931-1018de0056c4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:06.415243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-a8805bbb-8d56-4537-b931-1018de0056c4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:06.416105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-a8805bbb-8d56-4537-b931-1018de0056c4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:06.417475 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-a8805bbb-8d56-4537-b931-1018de0056c4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1663 microversion: 2.20 time: 0.361984 Jul 20 15:39:06.418022 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 408/812] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:06 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1663 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:39:06.435353 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-7743591c-e475-4e5c-9ad1-b1f75b54d9b4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8e59b799-a6fb-4e74-8af4-fe32152c2dd7"}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:39:06.436684 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-7743591c-e475-4e5c-9ad1-b1f75b54d9b4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:06.443310 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7743591c-e475-4e5c-9ad1-b1f75b54d9b4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:06.443756 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7743591c-e475-4e5c-9ad1-b1f75b54d9b4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:06.444517 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7743591c-e475-4e5c-9ad1-b1f75b54d9b4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:06.444956 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7743591c-e475-4e5c-9ad1-b1f75b54d9b4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:07.378339 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:07.383503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-ed0af997-c572-4634-a101-d9142480b198 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:07.384265 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-ed0af997-c572-4634-a101-d9142480b198 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:07.392109 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ed0af997-c572-4634-a101-d9142480b198 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:07.392548 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ed0af997-c572-4634-a101-d9142480b198 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:07.393308 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ed0af997-c572-4634-a101-d9142480b198 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:07.393734 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ed0af997-c572-4634-a101-d9142480b198 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:07.608159 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-ed0af997-c572-4634-a101-d9142480b198 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:07.617548 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-ed0af997-c572-4634-a101-d9142480b198 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1508 microversion: 2.1 time: 0.238003 Jul 20 15:39:07.618222 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 409/813] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:07 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1508 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:39:07.634295 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b51e7443-505a-4b58-b2b9-dc024fcc8632 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:39:07.641604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b51e7443-505a-4b58-b2b9-dc024fcc8632 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:07.641604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b51e7443-505a-4b58-b2b9-dc024fcc8632 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:07.641604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b51e7443-505a-4b58-b2b9-dc024fcc8632 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:07.642297 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b51e7443-505a-4b58-b2b9-dc024fcc8632 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:07.642719 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b51e7443-505a-4b58-b2b9-dc024fcc8632 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:07.952383 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b51e7443-505a-4b58-b2b9-dc024fcc8632 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "POST /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11/action" status: 202 len: 0 microversion: 2.1 time: 0.321799 Jul 20 15:39:07.956005 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 410/814] 10.222.0.78 () {60 vars in 1277 bytes} [Wed Jul 20 15:39:07 2022] POST /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 15:39:07.964699 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-c6731838-9dc7-4c19-9daa-f4700c566052 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:07.965756 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-c6731838-9dc7-4c19-9daa-f4700c566052 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:07.975046 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c6731838-9dc7-4c19-9daa-f4700c566052 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:07.975509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c6731838-9dc7-4c19-9daa-f4700c566052 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:07.976360 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c6731838-9dc7-4c19-9daa-f4700c566052 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:07.976799 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c6731838-9dc7-4c19-9daa-f4700c566052 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:07.982143 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-7743591c-e475-4e5c-9ad1-b1f75b54d9b4 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "POST /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.550811 Jul 20 15:39:07.984692 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 405/815] 10.222.0.78 () {62 vars in 1363 bytes} [Wed Jul 20 15:39:06 2022] POST /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7/os-volume_attachments => generated 188 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 15:39:08.139120 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-3e5a60e2-73f3-46b3-bd0c-af11438ee6e8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:08.140003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-3e5a60e2-73f3-46b3-bd0c-af11438ee6e8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:08.156018 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3e5a60e2-73f3-46b3-bd0c-af11438ee6e8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:08.156018 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3e5a60e2-73f3-46b3-bd0c-af11438ee6e8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:08.156018 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3e5a60e2-73f3-46b3-bd0c-af11438ee6e8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:08.156018 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3e5a60e2-73f3-46b3-bd0c-af11438ee6e8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:08.349964 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-c6731838-9dc7-4c19-9daa-f4700c566052 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:08.360152 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-c6731838-9dc7-4c19-9daa-f4700c566052 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1516 microversion: 2.1 time: 0.400418 Jul 20 15:39:08.361443 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 411/816] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:07 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1516 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:08.863675 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-3e5a60e2-73f3-46b3-bd0c-af11438ee6e8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7/os-volume_attachments/8e59b799-a6fb-4e74-8af4-fe32152c2dd7" status: 202 len: 0 microversion: 2.20 time: 0.728598 Jul 20 15:39:08.867177 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 406/817] 10.222.0.78 () {60 vars in 1456 bytes} [Wed Jul 20 15:39:08 2022] DELETE /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7/os-volume_attachments/8e59b799-a6fb-4e74-8af4-fe32152c2dd7 => generated 0 bytes in 730 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 15:39:08.920869 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-dfaf9659-4891-4f96-95c2-2c8f952eec45 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:39:08.921424 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-dfaf9659-4891-4f96-95c2-2c8f952eec45 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:08.927936 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dfaf9659-4891-4f96-95c2-2c8f952eec45 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:08.928379 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dfaf9659-4891-4f96-95c2-2c8f952eec45 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:08.929034 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dfaf9659-4891-4f96-95c2-2c8f952eec45 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:08.929459 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dfaf9659-4891-4f96-95c2-2c8f952eec45 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:09.223452 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-dfaf9659-4891-4f96-95c2-2c8f952eec45 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "POST /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7/action" status: 202 len: 0 microversion: 2.20 time: 0.306253 Jul 20 15:39:09.224140 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 412/818] 10.222.0.78 () {62 vars in 1318 bytes} [Wed Jul 20 15:39:08 2022] POST /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 15:39:09.233542 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c042fa4c-d1e4-4cfb-81ac-46d7a6231e68 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:09.234188 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c042fa4c-d1e4-4cfb-81ac-46d7a6231e68 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:09.244126 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c042fa4c-d1e4-4cfb-81ac-46d7a6231e68 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:09.245313 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c042fa4c-d1e4-4cfb-81ac-46d7a6231e68 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:09.246137 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c042fa4c-d1e4-4cfb-81ac-46d7a6231e68 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:09.246749 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c042fa4c-d1e4-4cfb-81ac-46d7a6231e68 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:09.286388 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-70bbdb3f-1116-477c-bf1f-eaa8a01243a5 req-79697047-fe91-47da-bf1d-7f2a5f4cf456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562e58cb-a1c0-4582-b4aa-46abf6053c11", "name": "network-vif-unplugged", "status": "completed", "tag": "5dcfcdca-0e07-4def-8734-604f0229a302"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:39:09.308696 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-70bbdb3f-1116-477c-bf1f-eaa8a01243a5 req-79697047-fe91-47da-bf1d-7f2a5f4cf456 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:09.309367 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-70bbdb3f-1116-477c-bf1f-eaa8a01243a5 req-79697047-fe91-47da-bf1d-7f2a5f4cf456 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:09.338647 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.compute.server_external_events [req-70bbdb3f-1116-477c-bf1f-eaa8a01243a5 req-79697047-fe91-47da-bf1d-7f2a5f4cf456 service nova] Unable to find a host for instance 562e58cb-a1c0-4582-b4aa-46abf6053c11. Dropping event network-vif-unplugged {{(pid=124712) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 15:39:09.341173 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-70bbdb3f-1116-477c-bf1f-eaa8a01243a5 req-79697047-fe91-47da-bf1d-7f2a5f4cf456 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.058565 Jul 20 15:39:09.342575 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 413/819] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 60 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 20 15:39:09.377874 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-62455750-f2a5-4903-98e7-c6e519f241fb tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:09.378916 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-62455750-f2a5-4903-98e7-c6e519f241fb tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:09.386167 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-62455750-f2a5-4903-98e7-c6e519f241fb tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:09.386652 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-62455750-f2a5-4903-98e7-c6e519f241fb tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:09.387479 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-62455750-f2a5-4903-98e7-c6e519f241fb tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:09.387945 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-62455750-f2a5-4903-98e7-c6e519f241fb tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:09.577538 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c042fa4c-d1e4-4cfb-81ac-46d7a6231e68 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:09.589680 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c042fa4c-d1e4-4cfb-81ac-46d7a6231e68 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:09.592164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c042fa4c-d1e4-4cfb-81ac-46d7a6231e68 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:09.596761 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c042fa4c-d1e4-4cfb-81ac-46d7a6231e68 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1671 microversion: 2.20 time: 0.365153 Jul 20 15:39:09.601156 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 407/820] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:09 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1671 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:39:09.729606 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-62455750-f2a5-4903-98e7-c6e519f241fb tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:09.750774 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-62455750-f2a5-4903-98e7-c6e519f241fb tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1516 microversion: 2.1 time: 0.371324 Jul 20 15:39:09.751935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 414/821] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:09 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1516 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:39:10.619725 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5eabf8e2-479f-48dc-9175-f82c654d6955 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:10.620351 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5eabf8e2-479f-48dc-9175-f82c654d6955 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:10.626413 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5eabf8e2-479f-48dc-9175-f82c654d6955 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:10.626852 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5eabf8e2-479f-48dc-9175-f82c654d6955 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:10.627607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5eabf8e2-479f-48dc-9175-f82c654d6955 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:10.628031 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5eabf8e2-479f-48dc-9175-f82c654d6955 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:10.768930 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-3353c3d3-4ed8-401c-ad59-c14fc965bdcd tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:10.770145 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-3353c3d3-4ed8-401c-ad59-c14fc965bdcd tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:10.775342 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5eabf8e2-479f-48dc-9175-f82c654d6955 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:10.786107 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5eabf8e2-479f-48dc-9175-f82c654d6955 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:10.792682 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3353c3d3-4ed8-401c-ad59-c14fc965bdcd tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:10.793215 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3353c3d3-4ed8-401c-ad59-c14fc965bdcd tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:10.794024 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3353c3d3-4ed8-401c-ad59-c14fc965bdcd tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:10.794491 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5eabf8e2-479f-48dc-9175-f82c654d6955 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:10.795781 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5eabf8e2-479f-48dc-9175-f82c654d6955 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1671 microversion: 2.20 time: 0.180025 Jul 20 15:39:10.796368 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 408/822] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:10 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1671 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:39:10.796929 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3353c3d3-4ed8-401c-ad59-c14fc965bdcd tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:10.954218 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-3353c3d3-4ed8-401c-ad59-c14fc965bdcd tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:10.962585 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-3353c3d3-4ed8-401c-ad59-c14fc965bdcd tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1518 microversion: 2.1 time: 0.197494 Jul 20 15:39:10.963148 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 415/823] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:10 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1518 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:11.813028 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d091e975-a068-4b52-b57d-36d0299f50f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:11.813631 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-d091e975-a068-4b52-b57d-36d0299f50f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:11.820155 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d091e975-a068-4b52-b57d-36d0299f50f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:11.820598 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d091e975-a068-4b52-b57d-36d0299f50f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:11.821353 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d091e975-a068-4b52-b57d-36d0299f50f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:11.821817 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d091e975-a068-4b52-b57d-36d0299f50f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:11.969957 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d091e975-a068-4b52-b57d-36d0299f50f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:11.984311 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d091e975-a068-4b52-b57d-36d0299f50f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:11.984823 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-12b38bb8-2144-43b4-8a2f-f55e618d808d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:11.985785 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-12b38bb8-2144-43b4-8a2f-f55e618d808d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:11.985934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d091e975-a068-4b52-b57d-36d0299f50f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:11.987019 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d091e975-a068-4b52-b57d-36d0299f50f6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1729 microversion: 2.20 time: 0.177911 Jul 20 15:39:11.991838 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 409/824] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:11 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:39:11.993402 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-12b38bb8-2144-43b4-8a2f-f55e618d808d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:11.993850 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-12b38bb8-2144-43b4-8a2f-f55e618d808d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:11.994663 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-12b38bb8-2144-43b4-8a2f-f55e618d808d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:11.995097 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-12b38bb8-2144-43b4-8a2f-f55e618d808d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:12.143279 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-12b38bb8-2144-43b4-8a2f-f55e618d808d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:12.152671 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-12b38bb8-2144-43b4-8a2f-f55e618d808d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1518 microversion: 2.1 time: 0.173174 Jul 20 15:39:12.153208 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 416/825] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:11 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1518 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:13.007300 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-fb291c9c-4cab-422f-90a7-773b24aca5b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:13.009979 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-fb291c9c-4cab-422f-90a7-773b24aca5b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:13.025847 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fb291c9c-4cab-422f-90a7-773b24aca5b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:13.026616 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fb291c9c-4cab-422f-90a7-773b24aca5b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:13.027550 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fb291c9c-4cab-422f-90a7-773b24aca5b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:13.043066 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fb291c9c-4cab-422f-90a7-773b24aca5b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:13.175918 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-90de7c78-6e2c-47e4-9cfb-69cd1596b438 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:13.177188 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-90de7c78-6e2c-47e4-9cfb-69cd1596b438 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:13.186671 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-90de7c78-6e2c-47e4-9cfb-69cd1596b438 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:13.187504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-90de7c78-6e2c-47e4-9cfb-69cd1596b438 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:13.188530 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-90de7c78-6e2c-47e4-9cfb-69cd1596b438 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:13.189093 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-90de7c78-6e2c-47e4-9cfb-69cd1596b438 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:13.300922 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-fb291c9c-4cab-422f-90a7-773b24aca5b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:13.333468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-fb291c9c-4cab-422f-90a7-773b24aca5b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:13.340919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-fb291c9c-4cab-422f-90a7-773b24aca5b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:13.346723 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-fb291c9c-4cab-422f-90a7-773b24aca5b6 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1729 microversion: 2.20 time: 0.344039 Jul 20 15:39:13.351299 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 410/826] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:13 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1729 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:39:13.726800 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-90de7c78-6e2c-47e4-9cfb-69cd1596b438 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:13.744652 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-90de7c78-6e2c-47e4-9cfb-69cd1596b438 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1518 microversion: 2.1 time: 0.573063 Jul 20 15:39:13.758306 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 417/827] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:13 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1518 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:14.371123 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-68116ea6-2ba8-4413-b3d7-474934f2e060 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:14.372391 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-68116ea6-2ba8-4413-b3d7-474934f2e060 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:14.380966 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-68116ea6-2ba8-4413-b3d7-474934f2e060 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:14.381727 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-68116ea6-2ba8-4413-b3d7-474934f2e060 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:14.382780 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-68116ea6-2ba8-4413-b3d7-474934f2e060 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:14.383455 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-68116ea6-2ba8-4413-b3d7-474934f2e060 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:14.565811 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-68116ea6-2ba8-4413-b3d7-474934f2e060 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:14.577146 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-68116ea6-2ba8-4413-b3d7-474934f2e060 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:14.578793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-68116ea6-2ba8-4413-b3d7-474934f2e060 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:14.580471 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-68116ea6-2ba8-4413-b3d7-474934f2e060 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1729 microversion: 2.20 time: 0.213265 Jul 20 15:39:14.582158 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 411/828] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:14 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1729 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:39:14.773951 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-2e1a35f1-f55a-49e8-a911-2539f48ae778 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:14.774712 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-2e1a35f1-f55a-49e8-a911-2539f48ae778 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:14.781826 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2e1a35f1-f55a-49e8-a911-2539f48ae778 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:14.782294 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2e1a35f1-f55a-49e8-a911-2539f48ae778 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:14.783066 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2e1a35f1-f55a-49e8-a911-2539f48ae778 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:14.783499 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2e1a35f1-f55a-49e8-a911-2539f48ae778 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:14.962436 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-2e1a35f1-f55a-49e8-a911-2539f48ae778 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:14.974576 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-2e1a35f1-f55a-49e8-a911-2539f48ae778 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1518 microversion: 2.1 time: 0.204736 Jul 20 15:39:14.975776 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 418/829] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:14 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1518 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:15.600937 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-45cb966c-96fd-49f5-baf1-505211283028 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:15.601551 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-45cb966c-96fd-49f5-baf1-505211283028 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:15.608834 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-45cb966c-96fd-49f5-baf1-505211283028 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:15.609293 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-45cb966c-96fd-49f5-baf1-505211283028 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:15.610283 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-45cb966c-96fd-49f5-baf1-505211283028 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:15.610526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-45cb966c-96fd-49f5-baf1-505211283028 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:15.798148 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-45cb966c-96fd-49f5-baf1-505211283028 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:15.810054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-45cb966c-96fd-49f5-baf1-505211283028 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:15.811953 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-45cb966c-96fd-49f5-baf1-505211283028 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:15.813484 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-45cb966c-96fd-49f5-baf1-505211283028 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1729 microversion: 2.20 time: 0.216444 Jul 20 15:39:15.817634 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 412/830] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:15 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:39:15.993921 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-4c3998d6-8a20-4895-a000-59f327ba7aa6 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:15.995720 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-4c3998d6-8a20-4895-a000-59f327ba7aa6 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:16.010522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4c3998d6-8a20-4895-a000-59f327ba7aa6 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:16.011955 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4c3998d6-8a20-4895-a000-59f327ba7aa6 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:16.016502 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4c3998d6-8a20-4895-a000-59f327ba7aa6 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:16.016502 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4c3998d6-8a20-4895-a000-59f327ba7aa6 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:16.234906 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4c3998d6-8a20-4895-a000-59f327ba7aa6 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:16.243062 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-4c3998d6-8a20-4895-a000-59f327ba7aa6 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1518 microversion: 2.1 time: 0.253865 Jul 20 15:39:16.243989 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 419/831] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:15 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1518 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:16.831740 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-0cb1968f-e895-458f-a69e-478342334ec9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:16.832340 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-0cb1968f-e895-458f-a69e-478342334ec9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:16.838950 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0cb1968f-e895-458f-a69e-478342334ec9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:16.839391 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0cb1968f-e895-458f-a69e-478342334ec9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:16.840169 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0cb1968f-e895-458f-a69e-478342334ec9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:16.840595 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0cb1968f-e895-458f-a69e-478342334ec9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:16.989088 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-0cb1968f-e895-458f-a69e-478342334ec9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:16.997902 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-0cb1968f-e895-458f-a69e-478342334ec9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:16.999620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-0cb1968f-e895-458f-a69e-478342334ec9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:17.000926 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-0cb1968f-e895-458f-a69e-478342334ec9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1729 microversion: 2.20 time: 0.173323 Jul 20 15:39:17.011406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 413/832] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:16 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:39:17.262120 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-4b7bb8a7-03ec-4468-b6e3-601af03e29e5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:17.262763 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-4b7bb8a7-03ec-4468-b6e3-601af03e29e5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:17.271897 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4b7bb8a7-03ec-4468-b6e3-601af03e29e5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:17.272617 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4b7bb8a7-03ec-4468-b6e3-601af03e29e5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:17.274473 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4b7bb8a7-03ec-4468-b6e3-601af03e29e5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:17.274473 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4b7bb8a7-03ec-4468-b6e3-601af03e29e5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:17.280751 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:17.439674 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4b7bb8a7-03ec-4468-b6e3-601af03e29e5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:17.450933 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-4b7bb8a7-03ec-4468-b6e3-601af03e29e5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1518 microversion: 2.1 time: 0.193474 Jul 20 15:39:17.452373 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 420/833] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:17 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1518 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:18.020914 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-859e0675-4ccb-4bc3-b6bf-3261e179158b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:18.022625 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-859e0675-4ccb-4bc3-b6bf-3261e179158b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:18.031980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-859e0675-4ccb-4bc3-b6bf-3261e179158b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:18.032805 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-859e0675-4ccb-4bc3-b6bf-3261e179158b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:18.033907 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-859e0675-4ccb-4bc3-b6bf-3261e179158b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:18.034595 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-859e0675-4ccb-4bc3-b6bf-3261e179158b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:18.243700 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-859e0675-4ccb-4bc3-b6bf-3261e179158b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:18.243700 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-859e0675-4ccb-4bc3-b6bf-3261e179158b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:18.244004 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-859e0675-4ccb-4bc3-b6bf-3261e179158b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:18.245102 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-859e0675-4ccb-4bc3-b6bf-3261e179158b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1729 microversion: 2.20 time: 0.229336 Jul 20 15:39:18.245663 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 414/834] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:18 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1729 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:39:18.470633 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-58ea1963-cdec-4ca8-81b9-db6a6267501c tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:18.477374 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-58ea1963-cdec-4ca8-81b9-db6a6267501c tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:18.480756 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-58ea1963-cdec-4ca8-81b9-db6a6267501c tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:18.481197 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-58ea1963-cdec-4ca8-81b9-db6a6267501c tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:18.481959 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-58ea1963-cdec-4ca8-81b9-db6a6267501c tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:18.482493 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-58ea1963-cdec-4ca8-81b9-db6a6267501c tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:18.638739 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-58ea1963-cdec-4ca8-81b9-db6a6267501c tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:18.649223 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-58ea1963-cdec-4ca8-81b9-db6a6267501c tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1518 microversion: 2.1 time: 0.182431 Jul 20 15:39:18.649901 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 421/835] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:18 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:19.265023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-81969b50-8130-47a0-b542-98e5b1577eef tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:19.265868 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-81969b50-8130-47a0-b542-98e5b1577eef tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:19.279544 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-81969b50-8130-47a0-b542-98e5b1577eef tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:19.286131 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-81969b50-8130-47a0-b542-98e5b1577eef tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:19.286131 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-81969b50-8130-47a0-b542-98e5b1577eef tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:19.286131 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-81969b50-8130-47a0-b542-98e5b1577eef tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:19.454721 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-81969b50-8130-47a0-b542-98e5b1577eef tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:19.463084 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-81969b50-8130-47a0-b542-98e5b1577eef tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:19.465290 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-81969b50-8130-47a0-b542-98e5b1577eef tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:19.466969 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-81969b50-8130-47a0-b542-98e5b1577eef tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1729 microversion: 2.20 time: 0.206547 Jul 20 15:39:19.468165 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 415/836] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:19 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:39:19.667623 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e3fe437f-3575-43ad-b217-98871fdca651 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:19.668238 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e3fe437f-3575-43ad-b217-98871fdca651 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:19.675620 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e3fe437f-3575-43ad-b217-98871fdca651 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:19.676532 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e3fe437f-3575-43ad-b217-98871fdca651 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:19.677708 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e3fe437f-3575-43ad-b217-98871fdca651 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:19.678375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e3fe437f-3575-43ad-b217-98871fdca651 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:19.833256 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-e3fe437f-3575-43ad-b217-98871fdca651 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:19.841781 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-e3fe437f-3575-43ad-b217-98871fdca651 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1518 microversion: 2.1 time: 0.178314 Jul 20 15:39:19.842712 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 422/837] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:19 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:20.488461 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d7a043af-38d0-436b-b61f-cfed1795fbc5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:20.489067 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-d7a043af-38d0-436b-b61f-cfed1795fbc5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:20.495836 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d7a043af-38d0-436b-b61f-cfed1795fbc5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:20.496277 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d7a043af-38d0-436b-b61f-cfed1795fbc5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:20.497218 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d7a043af-38d0-436b-b61f-cfed1795fbc5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:20.497645 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d7a043af-38d0-436b-b61f-cfed1795fbc5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:20.670518 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d7a043af-38d0-436b-b61f-cfed1795fbc5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:20.679595 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d7a043af-38d0-436b-b61f-cfed1795fbc5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:20.681129 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d7a043af-38d0-436b-b61f-cfed1795fbc5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:20.682371 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d7a043af-38d0-436b-b61f-cfed1795fbc5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1729 microversion: 2.20 time: 0.201165 Jul 20 15:39:20.695841 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 416/838] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:20 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1729 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:39:20.861230 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-32025dd5-b4f5-4af9-897b-2c3d9f049622 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:20.861928 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-32025dd5-b4f5-4af9-897b-2c3d9f049622 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:20.868816 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-32025dd5-b4f5-4af9-897b-2c3d9f049622 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:20.869846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-32025dd5-b4f5-4af9-897b-2c3d9f049622 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:20.870903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-32025dd5-b4f5-4af9-897b-2c3d9f049622 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:20.871419 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-32025dd5-b4f5-4af9-897b-2c3d9f049622 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:21.047385 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-32025dd5-b4f5-4af9-897b-2c3d9f049622 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:21.056433 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-32025dd5-b4f5-4af9-897b-2c3d9f049622 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1518 microversion: 2.1 time: 0.199443 Jul 20 15:39:21.067724 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 423/839] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:20 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1518 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:21.702506 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-8ba3ade0-5a8b-4add-b86c-181cf894ad31 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:21.703110 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-8ba3ade0-5a8b-4add-b86c-181cf894ad31 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:21.710020 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8ba3ade0-5a8b-4add-b86c-181cf894ad31 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:21.710508 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8ba3ade0-5a8b-4add-b86c-181cf894ad31 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:21.711263 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8ba3ade0-5a8b-4add-b86c-181cf894ad31 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:21.711694 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8ba3ade0-5a8b-4add-b86c-181cf894ad31 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:21.868281 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-8ba3ade0-5a8b-4add-b86c-181cf894ad31 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:21.877142 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-8ba3ade0-5a8b-4add-b86c-181cf894ad31 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:21.878810 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-8ba3ade0-5a8b-4add-b86c-181cf894ad31 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:21.880043 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-8ba3ade0-5a8b-4add-b86c-181cf894ad31 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1729 microversion: 2.20 time: 0.181769 Jul 20 15:39:21.880544 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 417/840] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:21 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:39:22.076611 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-a1c4b7dd-74fe-4c39-8bbf-49689825832d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:22.077436 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-a1c4b7dd-74fe-4c39-8bbf-49689825832d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:22.103177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a1c4b7dd-74fe-4c39-8bbf-49689825832d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:22.103757 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a1c4b7dd-74fe-4c39-8bbf-49689825832d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:22.104581 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a1c4b7dd-74fe-4c39-8bbf-49689825832d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:22.105017 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a1c4b7dd-74fe-4c39-8bbf-49689825832d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:22.249319 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-a1c4b7dd-74fe-4c39-8bbf-49689825832d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:22.257378 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-a1c4b7dd-74fe-4c39-8bbf-49689825832d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1518 microversion: 2.1 time: 0.187119 Jul 20 15:39:22.258060 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 424/841] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:22 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1518 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:22.914568 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5a3b863a-ddab-45e6-9577-fb8390631f32 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:22.914568 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5a3b863a-ddab-45e6-9577-fb8390631f32 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:22.918072 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5a3b863a-ddab-45e6-9577-fb8390631f32 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:22.918555 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5a3b863a-ddab-45e6-9577-fb8390631f32 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:22.919348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5a3b863a-ddab-45e6-9577-fb8390631f32 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:22.919780 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5a3b863a-ddab-45e6-9577-fb8390631f32 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:23.064387 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5a3b863a-ddab-45e6-9577-fb8390631f32 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:23.068196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:UPDATE=7,nova_cell1:INSERT=3,nova_cell1:SELECT=90 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:23.073412 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5a3b863a-ddab-45e6-9577-fb8390631f32 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:23.080221 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5a3b863a-ddab-45e6-9577-fb8390631f32 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:23.080221 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5a3b863a-ddab-45e6-9577-fb8390631f32 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1729 microversion: 2.20 time: 0.181091 Jul 20 15:39:23.080221 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 418/842] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:22 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:39:23.258426 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-c509df4a-4c5a-4a47-831a-89daf41d548f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Action: 'create', calling method: .version_select at 0x7efd9096c160>, body: {"keypair": {"name": "tempest-keypair-24852007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhsImPrzpVlhkz4YFYMZrepj/3WlVAbt9LeH3E8hE16oWqMnYbpsmWBt+fSL1ajWxHbHVaDZIEvG6BrCSX/vhb3e4ngoqrRd/MV5vHDqtaQz7K78fSP+s6KbW9Oq1mbnA=="}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:39:23.273351 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-c509df4a-4c5a-4a47-831a-89daf41d548f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Getting quotas for project 44dc2a5c754d42d1862b331afef2183f. Resources: {'key_pairs'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:39:23.280720 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e6b4e22c-e507-44c4-a5e3-c220876996ef tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:23.280720 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e6b4e22c-e507-44c4-a5e3-c220876996ef tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:23.280971 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-c509df4a-4c5a-4a47-831a-89daf41d548f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Getting quotas for user 0235b8fe92554131ba30e1d18f0f2d86 and project 44dc2a5c754d42d1862b331afef2183f. Resources: {'key_pairs'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:39:23.283793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e6b4e22c-e507-44c4-a5e3-c220876996ef tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:23.284253 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e6b4e22c-e507-44c4-a5e3-c220876996ef tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:23.285016 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e6b4e22c-e507-44c4-a5e3-c220876996ef tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:23.285458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e6b4e22c-e507-44c4-a5e3-c220876996ef tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:23.433857 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e6b4e22c-e507-44c4-a5e3-c220876996ef tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:23.438719 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e6b4e22c-e507-44c4-a5e3-c220876996ef tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1518 microversion: 2.1 time: 0.167201 Jul 20 15:39:23.439660 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 419/843] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:23 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:39:23.460679 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-c509df4a-4c5a-4a47-831a-89daf41d548f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.205865 Jul 20 15:39:23.467891 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 425/844] 10.222.0.78 () {60 vars in 1158 bytes} [Wed Jul 20 15:39:23 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:39:24.103355 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-2f14e3c5-95cb-4e50-b1d4-914d734f1384 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:24.104568 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-2f14e3c5-95cb-4e50-b1d4-914d734f1384 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:24.107343 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:24.112759 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2f14e3c5-95cb-4e50-b1d4-914d734f1384 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:24.113218 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2f14e3c5-95cb-4e50-b1d4-914d734f1384 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:24.114027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2f14e3c5-95cb-4e50-b1d4-914d734f1384 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:24.114517 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2f14e3c5-95cb-4e50-b1d4-914d734f1384 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:24.265476 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2f14e3c5-95cb-4e50-b1d4-914d734f1384 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:24.273559 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2f14e3c5-95cb-4e50-b1d4-914d734f1384 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:24.275109 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2f14e3c5-95cb-4e50-b1d4-914d734f1384 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:24.276288 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-2f14e3c5-95cb-4e50-b1d4-914d734f1384 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1729 microversion: 2.20 time: 0.181866 Jul 20 15:39:24.276846 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 420/845] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:24 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:39:24.457593 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-76fa2832-b5c9-4b65-a3b5-ebf137f38161 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:24.458136 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-76fa2832-b5c9-4b65-a3b5-ebf137f38161 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:24.466760 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-76fa2832-b5c9-4b65-a3b5-ebf137f38161 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:24.467957 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-76fa2832-b5c9-4b65-a3b5-ebf137f38161 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:24.468756 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-76fa2832-b5c9-4b65-a3b5-ebf137f38161 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:24.469199 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-76fa2832-b5c9-4b65-a3b5-ebf137f38161 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:24.626318 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-76fa2832-b5c9-4b65-a3b5-ebf137f38161 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:24.639171 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-76fa2832-b5c9-4b65-a3b5-ebf137f38161 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1574 microversion: 2.1 time: 0.180916 Jul 20 15:39:24.639777 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 426/846] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:24 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1574 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:25.295810 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-317c15f1-e08d-4f6f-ab91-db7a2c6191dd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:25.297185 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-317c15f1-e08d-4f6f-ab91-db7a2c6191dd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:25.305020 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-317c15f1-e08d-4f6f-ab91-db7a2c6191dd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:25.305737 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-317c15f1-e08d-4f6f-ab91-db7a2c6191dd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:25.307276 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-317c15f1-e08d-4f6f-ab91-db7a2c6191dd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:25.307723 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-317c15f1-e08d-4f6f-ab91-db7a2c6191dd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:25.600018 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-317c15f1-e08d-4f6f-ab91-db7a2c6191dd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:25.600018 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-317c15f1-e08d-4f6f-ab91-db7a2c6191dd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:25.600380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-317c15f1-e08d-4f6f-ab91-db7a2c6191dd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:25.600380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-317c15f1-e08d-4f6f-ab91-db7a2c6191dd tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1729 microversion: 2.20 time: 0.184611 Jul 20 15:39:25.600380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 421/847] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:25 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:39:25.655818 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-52c8ec51-2987-4819-a4e6-c73c77f6608e tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:25.656441 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-52c8ec51-2987-4819-a4e6-c73c77f6608e tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:25.663223 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-52c8ec51-2987-4819-a4e6-c73c77f6608e tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:25.663668 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-52c8ec51-2987-4819-a4e6-c73c77f6608e tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:25.664426 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-52c8ec51-2987-4819-a4e6-c73c77f6608e tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:25.664863 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-52c8ec51-2987-4819-a4e6-c73c77f6608e tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:25.812469 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-52c8ec51-2987-4819-a4e6-c73c77f6608e tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:25.821977 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-52c8ec51-2987-4819-a4e6-c73c77f6608e tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1574 microversion: 2.1 time: 0.169790 Jul 20 15:39:25.822836 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 427/848] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:25 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:26.494833 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-9531bbaa-6a91-4f70-add9-2e0f02b84aa7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:26.496061 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-9531bbaa-6a91-4f70-add9-2e0f02b84aa7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:26.505155 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9531bbaa-6a91-4f70-add9-2e0f02b84aa7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:26.506107 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9531bbaa-6a91-4f70-add9-2e0f02b84aa7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:26.507658 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9531bbaa-6a91-4f70-add9-2e0f02b84aa7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:26.508284 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9531bbaa-6a91-4f70-add9-2e0f02b84aa7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:26.647239 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-9531bbaa-6a91-4f70-add9-2e0f02b84aa7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:26.656819 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-9531bbaa-6a91-4f70-add9-2e0f02b84aa7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:26.658344 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-9531bbaa-6a91-4f70-add9-2e0f02b84aa7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:26.659904 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-9531bbaa-6a91-4f70-add9-2e0f02b84aa7 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1729 microversion: 2.20 time: 0.168886 Jul 20 15:39:26.660080 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 422/849] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:26 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:39:26.843632 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-87f3b84c-eee4-424f-9f7c-9ee889553dd3 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:26.844954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-87f3b84c-eee4-424f-9f7c-9ee889553dd3 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:26.855229 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-87f3b84c-eee4-424f-9f7c-9ee889553dd3 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:26.856358 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-87f3b84c-eee4-424f-9f7c-9ee889553dd3 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:26.857439 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-87f3b84c-eee4-424f-9f7c-9ee889553dd3 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:26.858131 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-87f3b84c-eee4-424f-9f7c-9ee889553dd3 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:27.093667 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-87f3b84c-eee4-424f-9f7c-9ee889553dd3 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:27.093667 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-87f3b84c-eee4-424f-9f7c-9ee889553dd3 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1574 microversion: 2.1 time: 0.246131 Jul 20 15:39:27.093667 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 428/850] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:26 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1574 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:27.503290 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-8ac50bfd-1ece-45e4-be37-430191ad5d7d req-365b87c3-e744-48ad-983a-0f967c73d467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1f04603-2085-4cc0-8263-d9c95c31f8a7", "name": "network-vif-plugged", "status": "completed", "tag": "a14d5f16-fe56-45ba-b07b-4affc5762962"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:39:27.512468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-8ac50bfd-1ece-45e4-be37-430191ad5d7d req-365b87c3-e744-48ad-983a-0f967c73d467 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:27.512834 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-8ac50bfd-1ece-45e4-be37-430191ad5d7d req-365b87c3-e744-48ad-983a-0f967c73d467 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:27.523904 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-8ac50bfd-1ece-45e4-be37-430191ad5d7d req-365b87c3-e744-48ad-983a-0f967c73d467 service nova] Creating event network-vif-plugged:a14d5f16-fe56-45ba-b07b-4affc5762962 for instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 on hv-cinder-81914 Jul 20 15:39:27.529359 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-8ac50bfd-1ece-45e4-be37-430191ad5d7d req-365b87c3-e744-48ad-983a-0f967c73d467 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030733 Jul 20 15:39:27.530000 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 423/851] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:39:27.677483 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-ec195ab9-995d-4444-9585-7477bb7fb958 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:27.678246 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-ec195ab9-995d-4444-9585-7477bb7fb958 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:27.684460 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ec195ab9-995d-4444-9585-7477bb7fb958 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:27.685003 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ec195ab9-995d-4444-9585-7477bb7fb958 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:27.685820 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ec195ab9-995d-4444-9585-7477bb7fb958 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:27.686298 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ec195ab9-995d-4444-9585-7477bb7fb958 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:27.911561 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-ec195ab9-995d-4444-9585-7477bb7fb958 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:27.923483 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-ec195ab9-995d-4444-9585-7477bb7fb958 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:27.924996 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-ec195ab9-995d-4444-9585-7477bb7fb958 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:27.926186 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-ec195ab9-995d-4444-9585-7477bb7fb958 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1729 microversion: 2.20 time: 0.252757 Jul 20 15:39:27.926783 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 429/852] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:27 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1729 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:39:28.103443 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-109fe318-4dfd-4c52-96de-c3b20382bce7 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:28.104150 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-109fe318-4dfd-4c52-96de-c3b20382bce7 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:28.111219 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-109fe318-4dfd-4c52-96de-c3b20382bce7 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:28.111677 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-109fe318-4dfd-4c52-96de-c3b20382bce7 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:28.112457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-109fe318-4dfd-4c52-96de-c3b20382bce7 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:28.113068 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-109fe318-4dfd-4c52-96de-c3b20382bce7 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:28.264573 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-109fe318-4dfd-4c52-96de-c3b20382bce7 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:28.272053 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-109fe318-4dfd-4c52-96de-c3b20382bce7 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1574 microversion: 2.1 time: 0.173787 Jul 20 15:39:28.272630 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 424/853] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:28 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:28.473988 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-8f8f68e9-a930-4a5e-b933-cd161d919560 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1560859255", "imageRef": "80914b1c-623c-42a8-810e-836b2cce0d3b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c0af21f-0efa-47e6-8a0b-19b7c3e7c8bc"}], "security_groups": [{"name": "tempest-securitygroup--1850035640"}], "key_name": "tempest-keypair-24852007", "user_data": "}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:39:28.585833 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.network.neutron [None req-8f8f68e9-a930-4a5e-b933-cd161d919560 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] validate_networks() for [('4c0af21f-0efa-47e6-8a0b-19b7c3e7c8bc', None, None, None, None, None)] {{(pid=124712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 15:39:28.945049 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-24cb58d0-db80-4b8d-a15d-5d903f514d1b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:28.945594 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-24cb58d0-db80-4b8d-a15d-5d903f514d1b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:28.952620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-24cb58d0-db80-4b8d-a15d-5d903f514d1b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:28.953064 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-24cb58d0-db80-4b8d-a15d-5d903f514d1b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:28.953823 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-24cb58d0-db80-4b8d-a15d-5d903f514d1b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:28.954255 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-24cb58d0-db80-4b8d-a15d-5d903f514d1b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:28.974215 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-8f8f68e9-a930-4a5e-b933-cd161d919560 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Flavor limits 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 15:39:28.974751 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-8f8f68e9-a930-4a5e-b933-cd161d919560 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Image limits 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 15:39:28.975109 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-8f8f68e9-a930-4a5e-b933-cd161d919560 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Flavor pref 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 15:39:28.975508 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-8f8f68e9-a930-4a5e-b933-cd161d919560 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Image pref 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 15:39:28.975906 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-8f8f68e9-a930-4a5e-b933-cd161d919560 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 15:39:28.986427 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8f8f68e9-a930-4a5e-b933-cd161d919560 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:28.986867 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8f8f68e9-a930-4a5e-b933-cd161d919560 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:28.987651 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8f8f68e9-a930-4a5e-b933-cd161d919560 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:28.988080 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8f8f68e9-a930-4a5e-b933-cd161d919560 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:29.005461 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-8f8f68e9-a930-4a5e-b933-cd161d919560 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Getting quotas for project 44dc2a5c754d42d1862b331afef2183f. Resources: {'instances', 'ram', 'cores'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:39:29.009588 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-8f8f68e9-a930-4a5e-b933-cd161d919560 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Getting quotas for user 0235b8fe92554131ba30e1d18f0f2d86 and project 44dc2a5c754d42d1862b331afef2183f. Resources: {'instances', 'ram', 'cores'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:39:29.021737 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-8f8f68e9-a930-4a5e-b933-cd161d919560 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Going to run 1 instances... {{(pid=124712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 15:39:29.029151 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-8f8f68e9-a930-4a5e-b933-cd161d919560 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80914b1c-623c-42a8-810e-836b2cce0d3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 15:39:29.093201 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-24cb58d0-db80-4b8d-a15d-5d903f514d1b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:29.098352 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-24cb58d0-db80-4b8d-a15d-5d903f514d1b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:29.099912 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-24cb58d0-db80-4b8d-a15d-5d903f514d1b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:29.101075 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-24cb58d0-db80-4b8d-a15d-5d903f514d1b tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1729 microversion: 2.20 time: 0.160524 Jul 20 15:39:29.101636 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 425/854] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:28 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:39:29.254475 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-8f8f68e9-a930-4a5e-b933-cd161d919560 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.785161 Jul 20 15:39:29.255482 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 430/855] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Jul 20 15:39:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 15:39:29.265370 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-fe2a909c-b564-49de-83ad-5e5da030f7f4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:29.265987 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-fe2a909c-b564-49de-83ad-5e5da030f7f4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:29.289851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-51189514-944b-43aa-9cfd-e2d402b44885 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:29.290559 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-51189514-944b-43aa-9cfd-e2d402b44885 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:29.298136 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-51189514-944b-43aa-9cfd-e2d402b44885 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:29.298621 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-51189514-944b-43aa-9cfd-e2d402b44885 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:29.299750 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-51189514-944b-43aa-9cfd-e2d402b44885 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:29.300263 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-51189514-944b-43aa-9cfd-e2d402b44885 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:29.325337 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-fe2a909c-b564-49de-83ad-5e5da030f7f4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:29.336573 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-fe2a909c-b564-49de-83ad-5e5da030f7f4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 200 len: 1240 microversion: 2.1 time: 0.074816 Jul 20 15:39:29.337524 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 426/856] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:29 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 1240 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:29.450783 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-51189514-944b-43aa-9cfd-e2d402b44885 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:29.458932 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-51189514-944b-43aa-9cfd-e2d402b44885 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1574 microversion: 2.1 time: 0.173624 Jul 20 15:39:29.459501 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 431/857] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:29 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:39:30.120161 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-4c88a914-264d-4823-bb70-cae8323958e9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:30.120913 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-4c88a914-264d-4823-bb70-cae8323958e9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:30.128341 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4c88a914-264d-4823-bb70-cae8323958e9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:30.128811 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4c88a914-264d-4823-bb70-cae8323958e9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:30.131337 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4c88a914-264d-4823-bb70-cae8323958e9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:30.131337 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4c88a914-264d-4823-bb70-cae8323958e9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:30.262773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-4c88a914-264d-4823-bb70-cae8323958e9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:30.270679 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-4c88a914-264d-4823-bb70-cae8323958e9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:30.272204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-4c88a914-264d-4823-bb70-cae8323958e9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:30.273356 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-4c88a914-264d-4823-bb70-cae8323958e9 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1729 microversion: 2.20 time: 0.157817 Jul 20 15:39:30.273915 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 427/858] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:30 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:39:30.355053 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-9c921711-ae51-43b3-a059-edc6cf1ad6b7 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:30.355580 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-9c921711-ae51-43b3-a059-edc6cf1ad6b7 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:30.409815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-9c921711-ae51-43b3-a059-edc6cf1ad6b7 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:30.417834 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-9c921711-ae51-43b3-a059-edc6cf1ad6b7 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 200 len: 1240 microversion: 2.1 time: 0.067084 Jul 20 15:39:30.418229 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 432/859] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:30 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:30.481535 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d2413fb3-02ec-4c9f-907b-74d325dc303c tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:30.482147 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-d2413fb3-02ec-4c9f-907b-74d325dc303c tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:30.488380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d2413fb3-02ec-4c9f-907b-74d325dc303c tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:30.488883 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d2413fb3-02ec-4c9f-907b-74d325dc303c tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:30.489656 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d2413fb3-02ec-4c9f-907b-74d325dc303c tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:30.490095 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d2413fb3-02ec-4c9f-907b-74d325dc303c tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:30.641462 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d2413fb3-02ec-4c9f-907b-74d325dc303c tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:30.649214 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d2413fb3-02ec-4c9f-907b-74d325dc303c tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1574 microversion: 2.1 time: 0.172221 Jul 20 15:39:30.649797 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 428/860] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:30 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:39:31.292405 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-f8023dd1-7733-4b92-b528-09725607b34e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:31.293016 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-f8023dd1-7733-4b92-b528-09725607b34e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:31.299351 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f8023dd1-7733-4b92-b528-09725607b34e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:31.299796 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f8023dd1-7733-4b92-b528-09725607b34e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:31.300655 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f8023dd1-7733-4b92-b528-09725607b34e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:31.301355 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f8023dd1-7733-4b92-b528-09725607b34e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:31.434636 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-8f6a0897-11d3-42dc-a323-dac4c72129f9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:31.436252 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-8f6a0897-11d3-42dc-a323-dac4c72129f9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:31.446630 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-f8023dd1-7733-4b92-b528-09725607b34e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:31.456426 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8f6a0897-11d3-42dc-a323-dac4c72129f9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:31.456908 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8f6a0897-11d3-42dc-a323-dac4c72129f9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:31.457818 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8f6a0897-11d3-42dc-a323-dac4c72129f9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:31.458458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8f6a0897-11d3-42dc-a323-dac4c72129f9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:31.475684 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-f8023dd1-7733-4b92-b528-09725607b34e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:31.480206 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-f8023dd1-7733-4b92-b528-09725607b34e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:31.484367 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-f8023dd1-7733-4b92-b528-09725607b34e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1729 microversion: 2.20 time: 0.195442 Jul 20 15:39:31.485392 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 433/861] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:31 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:39:31.546664 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-8f6a0897-11d3-42dc-a323-dac4c72129f9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:31.554658 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-8f6a0897-11d3-42dc-a323-dac4c72129f9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 200 len: 1236 microversion: 2.1 time: 0.124568 Jul 20 15:39:31.555272 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 429/862] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:31 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 1236 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:39:31.667028 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-394f2b38-0688-4b48-a884-31e7378f970e tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:31.668191 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-394f2b38-0688-4b48-a884-31e7378f970e tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:31.674342 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-394f2b38-0688-4b48-a884-31e7378f970e tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:31.674796 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-394f2b38-0688-4b48-a884-31e7378f970e tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:31.675563 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-394f2b38-0688-4b48-a884-31e7378f970e tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:31.676001 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-394f2b38-0688-4b48-a884-31e7378f970e tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:31.816038 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-394f2b38-0688-4b48-a884-31e7378f970e tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:31.824180 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-394f2b38-0688-4b48-a884-31e7378f970e tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1574 microversion: 2.1 time: 0.160519 Jul 20 15:39:31.824745 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 434/863] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:31 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:32.502909 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-0219ac85-3f5c-408b-9d5a-a4dee68ab357 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:32.503514 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-0219ac85-3f5c-408b-9d5a-a4dee68ab357 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:32.510087 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0219ac85-3f5c-408b-9d5a-a4dee68ab357 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:32.510634 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0219ac85-3f5c-408b-9d5a-a4dee68ab357 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:32.511425 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0219ac85-3f5c-408b-9d5a-a4dee68ab357 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:32.511855 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0219ac85-3f5c-408b-9d5a-a4dee68ab357 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:32.572491 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-58e58bd4-5d5a-4094-b1ca-caf7dde21e20 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:32.573107 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-58e58bd4-5d5a-4094-b1ca-caf7dde21e20 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:32.579869 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-58e58bd4-5d5a-4094-b1ca-caf7dde21e20 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:32.580574 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-58e58bd4-5d5a-4094-b1ca-caf7dde21e20 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:32.581332 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-58e58bd4-5d5a-4094-b1ca-caf7dde21e20 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:32.581758 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-58e58bd4-5d5a-4094-b1ca-caf7dde21e20 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:32.658582 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-58e58bd4-5d5a-4094-b1ca-caf7dde21e20 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:32.666328 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-58e58bd4-5d5a-4094-b1ca-caf7dde21e20 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 200 len: 1292 microversion: 2.1 time: 0.097634 Jul 20 15:39:32.666907 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 435/864] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:32 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 1292 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:39:32.685538 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-0219ac85-3f5c-408b-9d5a-a4dee68ab357 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:32.693661 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-0219ac85-3f5c-408b-9d5a-a4dee68ab357 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:32.695189 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-0219ac85-3f5c-408b-9d5a-a4dee68ab357 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:32.696457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-0219ac85-3f5c-408b-9d5a-a4dee68ab357 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1716 microversion: 2.20 time: 0.197318 Jul 20 15:39:32.697011 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 430/865] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:39:32 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1716 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 15:39:32.842337 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-fc11e57f-4901-4d82-9a65-d78b3b837da4 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:32.842946 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-fc11e57f-4901-4d82-9a65-d78b3b837da4 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:32.849103 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fc11e57f-4901-4d82-9a65-d78b3b837da4 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:32.849542 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fc11e57f-4901-4d82-9a65-d78b3b837da4 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:32.850398 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fc11e57f-4901-4d82-9a65-d78b3b837da4 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:32.850835 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fc11e57f-4901-4d82-9a65-d78b3b837da4 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:32.996197 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-fc11e57f-4901-4d82-9a65-d78b3b837da4 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:33.003732 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-fc11e57f-4901-4d82-9a65-d78b3b837da4 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1574 microversion: 2.1 time: 0.165843 Jul 20 15:39:33.004307 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 436/866] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:32 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:39:33.682722 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-22a31c0e-3b0a-4652-8dcf-3db87a422530 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:33.683866 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-22a31c0e-3b0a-4652-8dcf-3db87a422530 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:33.691598 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-22a31c0e-3b0a-4652-8dcf-3db87a422530 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:33.692040 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-22a31c0e-3b0a-4652-8dcf-3db87a422530 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:33.692929 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-22a31c0e-3b0a-4652-8dcf-3db87a422530 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:33.693358 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-22a31c0e-3b0a-4652-8dcf-3db87a422530 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:33.905143 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-22a31c0e-3b0a-4652-8dcf-3db87a422530 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:33.912505 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-22a31c0e-3b0a-4652-8dcf-3db87a422530 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 200 len: 1292 microversion: 2.1 time: 0.233621 Jul 20 15:39:33.913056 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 431/867] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:33 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 1292 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:34.020606 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b0787f8d-4033-4828-a825-2b664ca858d5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:34.021208 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b0787f8d-4033-4828-a825-2b664ca858d5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:34.027738 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b0787f8d-4033-4828-a825-2b664ca858d5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:34.028316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b0787f8d-4033-4828-a825-2b664ca858d5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:34.029093 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b0787f8d-4033-4828-a825-2b664ca858d5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:34.029504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b0787f8d-4033-4828-a825-2b664ca858d5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:34.164952 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b0787f8d-4033-4828-a825-2b664ca858d5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:34.173247 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b0787f8d-4033-4828-a825-2b664ca858d5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1574 microversion: 2.1 time: 0.156454 Jul 20 15:39:34.173903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 437/868] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:34 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:34.930358 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ce0477d7-9df0-456b-9ef1-f19fc3efc678 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:34.930964 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ce0477d7-9df0-456b-9ef1-f19fc3efc678 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:34.938112 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ce0477d7-9df0-456b-9ef1-f19fc3efc678 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:34.938647 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ce0477d7-9df0-456b-9ef1-f19fc3efc678 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:34.939406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ce0477d7-9df0-456b-9ef1-f19fc3efc678 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:34.939837 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ce0477d7-9df0-456b-9ef1-f19fc3efc678 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:35.001668 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-ce0477d7-9df0-456b-9ef1-f19fc3efc678 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:35.009139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-ce0477d7-9df0-456b-9ef1-f19fc3efc678 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 200 len: 1292 microversion: 2.1 time: 0.083028 Jul 20 15:39:35.009697 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 432/869] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:34 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:35.190546 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-50a1fd0e-b931-4015-b241-34a767401388 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:35.191114 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-50a1fd0e-b931-4015-b241-34a767401388 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:35.197660 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-50a1fd0e-b931-4015-b241-34a767401388 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:35.198106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-50a1fd0e-b931-4015-b241-34a767401388 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:35.198893 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-50a1fd0e-b931-4015-b241-34a767401388 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:35.199330 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-50a1fd0e-b931-4015-b241-34a767401388 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:35.333648 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-50a1fd0e-b931-4015-b241-34a767401388 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:35.342219 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-50a1fd0e-b931-4015-b241-34a767401388 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1574 microversion: 2.1 time: 0.155648 Jul 20 15:39:35.342820 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 438/870] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:35 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:36.025016 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-a8827fbf-1fce-49fe-afa8-217332a6d6ce tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:36.025622 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-a8827fbf-1fce-49fe-afa8-217332a6d6ce tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:36.032674 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a8827fbf-1fce-49fe-afa8-217332a6d6ce tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:36.033126 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a8827fbf-1fce-49fe-afa8-217332a6d6ce tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:36.033889 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a8827fbf-1fce-49fe-afa8-217332a6d6ce tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:36.034349 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a8827fbf-1fce-49fe-afa8-217332a6d6ce tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:36.102078 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-a8827fbf-1fce-49fe-afa8-217332a6d6ce tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:36.123514 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-a8827fbf-1fce-49fe-afa8-217332a6d6ce tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 200 len: 1300 microversion: 2.1 time: 0.102191 Jul 20 15:39:36.125917 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 433/871] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:36 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 1300 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:36.361074 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-23e58e61-556c-4d00-97d3-2276b541e9d2 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:36.361826 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-23e58e61-556c-4d00-97d3-2276b541e9d2 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:36.364023 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:36.370747 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-23e58e61-556c-4d00-97d3-2276b541e9d2 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:36.371205 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-23e58e61-556c-4d00-97d3-2276b541e9d2 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:36.373403 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-23e58e61-556c-4d00-97d3-2276b541e9d2 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:36.373403 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-23e58e61-556c-4d00-97d3-2276b541e9d2 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:36.389044 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=100 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:36.534471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-23e58e61-556c-4d00-97d3-2276b541e9d2 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:36.542385 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-23e58e61-556c-4d00-97d3-2276b541e9d2 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1574 microversion: 2.1 time: 0.185184 Jul 20 15:39:36.542964 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 439/872] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:36 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1574 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:37.141364 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-34e502b5-c4ba-455b-8c47-d84fbc1df997 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:37.141893 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-34e502b5-c4ba-455b-8c47-d84fbc1df997 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:37.148247 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-34e502b5-c4ba-455b-8c47-d84fbc1df997 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:37.148700 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-34e502b5-c4ba-455b-8c47-d84fbc1df997 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:37.149514 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-34e502b5-c4ba-455b-8c47-d84fbc1df997 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:37.149947 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-34e502b5-c4ba-455b-8c47-d84fbc1df997 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:37.303048 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-34e502b5-c4ba-455b-8c47-d84fbc1df997 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:37.314638 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-34e502b5-c4ba-455b-8c47-d84fbc1df997 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 200 len: 1366 microversion: 2.1 time: 0.177075 Jul 20 15:39:37.322493 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 434/873] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:37 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:37.560093 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-562a8975-760f-4adf-826c-d4b5b17e9cc5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:37.560711 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-562a8975-760f-4adf-826c-d4b5b17e9cc5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:37.568617 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-562a8975-760f-4adf-826c-d4b5b17e9cc5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:37.569070 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-562a8975-760f-4adf-826c-d4b5b17e9cc5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:37.569835 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-562a8975-760f-4adf-826c-d4b5b17e9cc5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:37.570297 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-562a8975-760f-4adf-826c-d4b5b17e9cc5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:37.752635 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-562a8975-760f-4adf-826c-d4b5b17e9cc5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:37.773714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-562a8975-760f-4adf-826c-d4b5b17e9cc5 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1574 microversion: 2.1 time: 0.217291 Jul 20 15:39:37.775120 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 440/874] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:37 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1574 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:38.145697 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-5af04179-8787-4945-9c0c-22d1f12607d6 req-663a8c49-8193-4b29-87f3-3e47e77e80d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84c1c67f-27a0-475d-9897-10786bf0bc74", "tag": "4be42035-ca2a-44b6-8ef1-f43eab23bd03"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:39:38.162492 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-5af04179-8787-4945-9c0c-22d1f12607d6 req-663a8c49-8193-4b29-87f3-3e47e77e80d7 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:38.163093 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-5af04179-8787-4945-9c0c-22d1f12607d6 req-663a8c49-8193-4b29-87f3-3e47e77e80d7 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:38.178707 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-5af04179-8787-4945-9c0c-22d1f12607d6 req-663a8c49-8193-4b29-87f3-3e47e77e80d7 service nova] Creating event network-changed:4be42035-ca2a-44b6-8ef1-f43eab23bd03 for instance 84c1c67f-27a0-475d-9897-10786bf0bc74 on hv-cinder-81914 Jul 20 15:39:38.195373 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-5af04179-8787-4945-9c0c-22d1f12607d6 req-663a8c49-8193-4b29-87f3-3e47e77e80d7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058611 Jul 20 15:39:38.197243 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 435/875] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:39:38.341742 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-de56ccc3-df9e-460d-924c-98be9adf9c65 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:38.342425 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-de56ccc3-df9e-460d-924c-98be9adf9c65 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:38.349920 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-de56ccc3-df9e-460d-924c-98be9adf9c65 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:38.350647 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-de56ccc3-df9e-460d-924c-98be9adf9c65 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:38.351588 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-de56ccc3-df9e-460d-924c-98be9adf9c65 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:38.352910 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-de56ccc3-df9e-460d-924c-98be9adf9c65 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:38.500631 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-de56ccc3-df9e-460d-924c-98be9adf9c65 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:38.509273 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-de56ccc3-df9e-460d-924c-98be9adf9c65 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 200 len: 1366 microversion: 2.1 time: 0.179378 Jul 20 15:39:38.509907 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 441/876] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:38 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:38.799600 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-4a1dd417-c519-4496-becd-6a3f6738d4c9 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:38.800448 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-4a1dd417-c519-4496-becd-6a3f6738d4c9 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:38.808167 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4a1dd417-c519-4496-becd-6a3f6738d4c9 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:38.808891 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4a1dd417-c519-4496-becd-6a3f6738d4c9 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:38.809830 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4a1dd417-c519-4496-becd-6a3f6738d4c9 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:38.810580 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4a1dd417-c519-4496-becd-6a3f6738d4c9 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:38.989742 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-4a1dd417-c519-4496-becd-6a3f6738d4c9 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:38.997450 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-4a1dd417-c519-4496-becd-6a3f6738d4c9 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1574 microversion: 2.1 time: 0.202325 Jul 20 15:39:38.998008 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 436/877] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:38 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1574 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:39.527082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-7f64ae4c-dbd9-443d-8603-78cc099428c0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:39.528291 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-7f64ae4c-dbd9-443d-8603-78cc099428c0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:39.531400 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=2 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:39.538328 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7f64ae4c-dbd9-443d-8603-78cc099428c0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:39.538971 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7f64ae4c-dbd9-443d-8603-78cc099428c0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:39.540060 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7f64ae4c-dbd9-443d-8603-78cc099428c0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:39.540746 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7f64ae4c-dbd9-443d-8603-78cc099428c0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:39.548149 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-b02ff43e-5bf4-4fa9-8dfa-a0e33d46314d req-7f5007eb-f3c6-4f86-aeae-03333d850a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562e58cb-a1c0-4582-b4aa-46abf6053c11", "name": "network-vif-plugged", "status": "completed", "tag": "5dcfcdca-0e07-4def-8734-604f0229a302"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:39:39.555781 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=2 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:39.559876 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-b02ff43e-5bf4-4fa9-8dfa-a0e33d46314d req-7f5007eb-f3c6-4f86-aeae-03333d850a53 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:39.560454 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-b02ff43e-5bf4-4fa9-8dfa-a0e33d46314d req-7f5007eb-f3c6-4f86-aeae-03333d850a53 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:39.573615 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-b02ff43e-5bf4-4fa9-8dfa-a0e33d46314d req-7f5007eb-f3c6-4f86-aeae-03333d850a53 service nova] Creating event network-vif-plugged:5dcfcdca-0e07-4def-8734-604f0229a302 for instance 562e58cb-a1c0-4582-b4aa-46abf6053c11 on hv-cinder-81914 Jul 20 15:39:39.578744 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-b02ff43e-5bf4-4fa9-8dfa-a0e33d46314d req-7f5007eb-f3c6-4f86-aeae-03333d850a53 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034268 Jul 20 15:39:39.579543 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 437/878] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:39:39.691093 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-7f64ae4c-dbd9-443d-8603-78cc099428c0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:39.702833 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-7f64ae4c-dbd9-443d-8603-78cc099428c0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 200 len: 1366 microversion: 2.1 time: 0.179723 Jul 20 15:39:39.703805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 442/879] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:39 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:39:40.017934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-3a62d1a1-eafc-49c4-a3bc-e5808622b6e8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:40.018687 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-3a62d1a1-eafc-49c4-a3bc-e5808622b6e8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:40.025411 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3a62d1a1-eafc-49c4-a3bc-e5808622b6e8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:40.025869 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3a62d1a1-eafc-49c4-a3bc-e5808622b6e8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:40.027278 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3a62d1a1-eafc-49c4-a3bc-e5808622b6e8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:40.027715 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3a62d1a1-eafc-49c4-a3bc-e5808622b6e8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:40.045877 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=100 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:40.181063 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-3a62d1a1-eafc-49c4-a3bc-e5808622b6e8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:40.189375 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-3a62d1a1-eafc-49c4-a3bc-e5808622b6e8 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1574 microversion: 2.1 time: 0.175571 Jul 20 15:39:40.189946 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 438/880] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:40 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:39:40.721485 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-2d44ee1f-3fbf-472b-8ee7-77624d3eba26 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:40.722131 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-2d44ee1f-3fbf-472b-8ee7-77624d3eba26 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:40.724027 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=12 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:39:40.729847 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2d44ee1f-3fbf-472b-8ee7-77624d3eba26 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:40.730326 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2d44ee1f-3fbf-472b-8ee7-77624d3eba26 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:40.731099 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2d44ee1f-3fbf-472b-8ee7-77624d3eba26 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:40.731533 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2d44ee1f-3fbf-472b-8ee7-77624d3eba26 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:40.869076 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-2d44ee1f-3fbf-472b-8ee7-77624d3eba26 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:40.877467 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-2d44ee1f-3fbf-472b-8ee7-77624d3eba26 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 200 len: 1366 microversion: 2.1 time: 0.160615 Jul 20 15:39:40.878087 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 443/881] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:40 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:41.207891 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d91b3858-9323-4c8c-9307-c6a12236b199 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:41.208692 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-d91b3858-9323-4c8c-9307-c6a12236b199 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:41.217741 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d91b3858-9323-4c8c-9307-c6a12236b199 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:41.223015 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d91b3858-9323-4c8c-9307-c6a12236b199 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:41.223015 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d91b3858-9323-4c8c-9307-c6a12236b199 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:41.223015 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d91b3858-9323-4c8c-9307-c6a12236b199 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:41.406812 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d91b3858-9323-4c8c-9307-c6a12236b199 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:41.421399 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d91b3858-9323-4c8c-9307-c6a12236b199 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1574 microversion: 2.1 time: 0.217872 Jul 20 15:39:41.421986 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 439/882] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:41 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1574 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:41.895899 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-77d4c1a0-62c0-4107-919a-60e226c496e5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:41.897303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-77d4c1a0-62c0-4107-919a-60e226c496e5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:41.905541 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-77d4c1a0-62c0-4107-919a-60e226c496e5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:41.906151 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-77d4c1a0-62c0-4107-919a-60e226c496e5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:41.921947 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-77d4c1a0-62c0-4107-919a-60e226c496e5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:41.921947 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-77d4c1a0-62c0-4107-919a-60e226c496e5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:42.071709 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-77d4c1a0-62c0-4107-919a-60e226c496e5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:42.081521 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-77d4c1a0-62c0-4107-919a-60e226c496e5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 200 len: 1366 microversion: 2.1 time: 0.190518 Jul 20 15:39:42.082472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 444/883] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:41 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:39:42.442128 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-193b6f41-341e-43c3-891f-6ffae9aefc5d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:42.442898 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-193b6f41-341e-43c3-891f-6ffae9aefc5d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:42.452159 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-193b6f41-341e-43c3-891f-6ffae9aefc5d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:42.453003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-193b6f41-341e-43c3-891f-6ffae9aefc5d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:42.453982 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-193b6f41-341e-43c3-891f-6ffae9aefc5d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:42.454552 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-193b6f41-341e-43c3-891f-6ffae9aefc5d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:42.600603 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-193b6f41-341e-43c3-891f-6ffae9aefc5d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:42.610879 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-193b6f41-341e-43c3-891f-6ffae9aefc5d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1561 microversion: 2.1 time: 0.174494 Jul 20 15:39:42.611612 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 440/884] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:42 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:43.099649 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-45e9bba1-7ada-4e73-a1bc-4bcc1cb46a1a tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:43.100649 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-45e9bba1-7ada-4e73-a1bc-4bcc1cb46a1a tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:43.108114 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-45e9bba1-7ada-4e73-a1bc-4bcc1cb46a1a tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:43.108564 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-45e9bba1-7ada-4e73-a1bc-4bcc1cb46a1a tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:43.109362 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-45e9bba1-7ada-4e73-a1bc-4bcc1cb46a1a tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:43.109810 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-45e9bba1-7ada-4e73-a1bc-4bcc1cb46a1a tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:43.258050 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-45e9bba1-7ada-4e73-a1bc-4bcc1cb46a1a tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:43.266465 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-45e9bba1-7ada-4e73-a1bc-4bcc1cb46a1a tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 200 len: 1366 microversion: 2.1 time: 0.170627 Jul 20 15:39:43.266740 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 445/885] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:43 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:39:44.283441 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-47ef85c4-204f-4911-a790-2fcb23d39197 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:44.284341 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-47ef85c4-204f-4911-a790-2fcb23d39197 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:44.290954 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-47ef85c4-204f-4911-a790-2fcb23d39197 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:44.291466 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-47ef85c4-204f-4911-a790-2fcb23d39197 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:44.293044 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-47ef85c4-204f-4911-a790-2fcb23d39197 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:44.293554 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-47ef85c4-204f-4911-a790-2fcb23d39197 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:44.429205 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-47ef85c4-204f-4911-a790-2fcb23d39197 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:44.437107 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-47ef85c4-204f-4911-a790-2fcb23d39197 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 200 len: 1366 microversion: 2.1 time: 0.157691 Jul 20 15:39:44.438185 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 441/886] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:44 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:45.456732 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b9663955-ad4a-4626-9c5e-d77e4b4ad1e7 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:45.457365 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b9663955-ad4a-4626-9c5e-d77e4b4ad1e7 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:45.475786 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b9663955-ad4a-4626-9c5e-d77e4b4ad1e7 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:45.476240 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b9663955-ad4a-4626-9c5e-d77e4b4ad1e7 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:45.477016 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b9663955-ad4a-4626-9c5e-d77e4b4ad1e7 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:45.477457 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b9663955-ad4a-4626-9c5e-d77e4b4ad1e7 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:45.619727 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b9663955-ad4a-4626-9c5e-d77e4b4ad1e7 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:45.628366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b9663955-ad4a-4626-9c5e-d77e4b4ad1e7 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 200 len: 1366 microversion: 2.1 time: 0.177154 Jul 20 15:39:45.628947 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 446/887] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:45 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:45.919390 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-5e80e0b5-e603-44aa-b393-cd6216c07851 req-8a278d09-c764-4205-9dcd-71520dc358a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c1c67f-27a0-475d-9897-10786bf0bc74", "name": "network-vif-plugged", "status": "completed", "tag": "4be42035-ca2a-44b6-8ef1-f43eab23bd03"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:39:45.928194 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-5e80e0b5-e603-44aa-b393-cd6216c07851 req-8a278d09-c764-4205-9dcd-71520dc358a8 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:45.937243 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-5e80e0b5-e603-44aa-b393-cd6216c07851 req-8a278d09-c764-4205-9dcd-71520dc358a8 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:45.943953 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-5e80e0b5-e603-44aa-b393-cd6216c07851 req-8a278d09-c764-4205-9dcd-71520dc358a8 service nova] Creating event network-vif-plugged:4be42035-ca2a-44b6-8ef1-f43eab23bd03 for instance 84c1c67f-27a0-475d-9897-10786bf0bc74 on hv-cinder-81914 Jul 20 15:39:45.949374 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-5e80e0b5-e603-44aa-b393-cd6216c07851 req-8a278d09-c764-4205-9dcd-71520dc358a8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034221 Jul 20 15:39:45.950080 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 442/888] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:39:46.647300 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-447342b8-1ea1-4911-9c94-86f581a7c5cc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:46.649941 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-447342b8-1ea1-4911-9c94-86f581a7c5cc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:46.657549 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-447342b8-1ea1-4911-9c94-86f581a7c5cc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:46.658063 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-447342b8-1ea1-4911-9c94-86f581a7c5cc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:46.660110 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-447342b8-1ea1-4911-9c94-86f581a7c5cc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:46.660110 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-447342b8-1ea1-4911-9c94-86f581a7c5cc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:46.812549 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-447342b8-1ea1-4911-9c94-86f581a7c5cc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:46.821450 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-447342b8-1ea1-4911-9c94-86f581a7c5cc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 200 len: 1366 microversion: 2.1 time: 0.178436 Jul 20 15:39:46.835251 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 447/889] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:46 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:47.839749 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d82ca724-d2e6-4a02-b54f-8f7b1456a496 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:47.840486 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-d82ca724-d2e6-4a02-b54f-8f7b1456a496 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:47.847634 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d82ca724-d2e6-4a02-b54f-8f7b1456a496 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:47.848262 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d82ca724-d2e6-4a02-b54f-8f7b1456a496 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:47.849216 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d82ca724-d2e6-4a02-b54f-8f7b1456a496 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:47.849781 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d82ca724-d2e6-4a02-b54f-8f7b1456a496 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:47.980811 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d82ca724-d2e6-4a02-b54f-8f7b1456a496 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:47.988194 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d82ca724-d2e6-4a02-b54f-8f7b1456a496 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 200 len: 1366 microversion: 2.1 time: 0.153807 Jul 20 15:39:47.988750 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 443/890] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:47 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:49.009166 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e166ab4c-48ff-4812-91ae-553fd950b91f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:49.009166 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e166ab4c-48ff-4812-91ae-553fd950b91f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:49.012402 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e166ab4c-48ff-4812-91ae-553fd950b91f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:49.012714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e166ab4c-48ff-4812-91ae-553fd950b91f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:49.013470 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e166ab4c-48ff-4812-91ae-553fd950b91f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:49.013902 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e166ab4c-48ff-4812-91ae-553fd950b91f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:49.140872 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-e166ab4c-48ff-4812-91ae-553fd950b91f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:39:49.148317 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-e166ab4c-48ff-4812-91ae-553fd950b91f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 200 len: 1555 microversion: 2.1 time: 0.147974 Jul 20 15:39:49.148877 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 448/891] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:39:48 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 1555 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:39:49.165031 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-91f39578-aef2-41a4-84b9-d07c08b05f81 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:39:49.165514 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-91f39578-aef2-41a4-84b9-d07c08b05f81 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:39:49.171541 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-91f39578-aef2-41a4-84b9-d07c08b05f81 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:49.171982 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-91f39578-aef2-41a4-84b9-d07c08b05f81 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:49.172725 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-91f39578-aef2-41a4-84b9-d07c08b05f81 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:49.173147 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-91f39578-aef2-41a4-84b9-d07c08b05f81 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:49.251643 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-91f39578-aef2-41a4-84b9-d07c08b05f81 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090516 Jul 20 15:39:49.252230 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 444/892] 10.222.0.78 () {58 vars in 1274 bytes} [Wed Jul 20 15:39:49 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:39:50.846496 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-8998c1ad-0d9a-437c-a21b-10290e5f9753 req-19f7f7fe-c1ed-4c00-890d-150f94e96314 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84c1c67f-27a0-475d-9897-10786bf0bc74", "tag": "4be42035-ca2a-44b6-8ef1-f43eab23bd03"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:39:50.855680 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-8998c1ad-0d9a-437c-a21b-10290e5f9753 req-19f7f7fe-c1ed-4c00-890d-150f94e96314 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:39:50.856110 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-8998c1ad-0d9a-437c-a21b-10290e5f9753 req-19f7f7fe-c1ed-4c00-890d-150f94e96314 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:39:50.867036 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-8998c1ad-0d9a-437c-a21b-10290e5f9753 req-19f7f7fe-c1ed-4c00-890d-150f94e96314 service nova] Creating event network-changed:4be42035-ca2a-44b6-8ef1-f43eab23bd03 for instance 84c1c67f-27a0-475d-9897-10786bf0bc74 on hv-cinder-81914 Jul 20 15:39:50.872481 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-8998c1ad-0d9a-437c-a21b-10290e5f9753 req-19f7f7fe-c1ed-4c00-890d-150f94e96314 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029422 Jul 20 15:39:50.872990 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 449/893] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:40:06.731712 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=51 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:40:06.733142 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=32 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:40:06.737215 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-483aed2a-58a8-4177-a513-a83ce1f0a9a8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:06.738143 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-483aed2a-58a8-4177-a513-a83ce1f0a9a8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:06.744082 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-483aed2a-58a8-4177-a513-a83ce1f0a9a8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:06.745962 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-483aed2a-58a8-4177-a513-a83ce1f0a9a8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:06.745962 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-483aed2a-58a8-4177-a513-a83ce1f0a9a8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:06.745962 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-483aed2a-58a8-4177-a513-a83ce1f0a9a8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:06.774054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-483aed2a-58a8-4177-a513-a83ce1f0a9a8 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043816 Jul 20 15:40:06.774693 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 445/894] 10.222.0.78 () {60 vars in 1342 bytes} [Wed Jul 20 15:40:06 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:40:06.830240 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=21 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:40:06.831299 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=59 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:40:06.836025 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e3c83171-5070-44d5-9edf-97629709054a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:06.836866 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e3c83171-5070-44d5-9edf-97629709054a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:06.843630 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e3c83171-5070-44d5-9edf-97629709054a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:06.844083 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e3c83171-5070-44d5-9edf-97629709054a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:06.844851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e3c83171-5070-44d5-9edf-97629709054a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:06.845313 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e3c83171-5070-44d5-9edf-97629709054a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:06.870530 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e3c83171-5070-44d5-9edf-97629709054a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Going to try to terminate instance {{(pid=124712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 15:40:07.262430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-e3c83171-5070-44d5-9edf-97629709054a tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 204 len: 0 microversion: 2.20 time: 0.434445 Jul 20 15:40:07.263019 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 450/895] 10.222.0.78 () {60 vars in 1279 bytes} [Wed Jul 20 15:40:06 2022] DELETE /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 15:40:07.272306 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-4a740e53-3f0e-4bed-8345-d40aff0b2144 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:07.272917 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-4a740e53-3f0e-4bed-8345-d40aff0b2144 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:07.279889 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4a740e53-3f0e-4bed-8345-d40aff0b2144 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:07.280334 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4a740e53-3f0e-4bed-8345-d40aff0b2144 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:07.281086 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4a740e53-3f0e-4bed-8345-d40aff0b2144 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:07.281516 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4a740e53-3f0e-4bed-8345-d40aff0b2144 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:07.425295 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-4a740e53-3f0e-4bed-8345-d40aff0b2144 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:07.428389 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-4a740e53-3f0e-4bed-8345-d40aff0b2144 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:07.429902 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-4a740e53-3f0e-4bed-8345-d40aff0b2144 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:07.431093 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-4a740e53-3f0e-4bed-8345-d40aff0b2144 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1722 microversion: 2.20 time: 0.163240 Jul 20 15:40:07.431641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 446/896] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:40:07 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:40:08.449772 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-8c587a54-5a13-4e7d-8b7c-ccd74dd41731 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:08.451147 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-8c587a54-5a13-4e7d-8b7c-ccd74dd41731 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:08.458050 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8c587a54-5a13-4e7d-8b7c-ccd74dd41731 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:08.458537 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8c587a54-5a13-4e7d-8b7c-ccd74dd41731 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:08.459309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8c587a54-5a13-4e7d-8b7c-ccd74dd41731 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:08.459751 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8c587a54-5a13-4e7d-8b7c-ccd74dd41731 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:08.590813 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-8c587a54-5a13-4e7d-8b7c-ccd74dd41731 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:08.599524 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-8c587a54-5a13-4e7d-8b7c-ccd74dd41731 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:08.601022 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-8c587a54-5a13-4e7d-8b7c-ccd74dd41731 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:08.602159 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-8c587a54-5a13-4e7d-8b7c-ccd74dd41731 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1722 microversion: 2.20 time: 0.156857 Jul 20 15:40:08.602855 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 451/897] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:40:08 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:40:09.620517 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-fb053999-8b91-4de7-8d41-6e395c2b57ab tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:09.621115 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-fb053999-8b91-4de7-8d41-6e395c2b57ab tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:09.628141 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fb053999-8b91-4de7-8d41-6e395c2b57ab tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:09.628575 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fb053999-8b91-4de7-8d41-6e395c2b57ab tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:09.629319 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fb053999-8b91-4de7-8d41-6e395c2b57ab tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:09.629745 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fb053999-8b91-4de7-8d41-6e395c2b57ab tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:09.695799 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-fb053999-8b91-4de7-8d41-6e395c2b57ab tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:09.706790 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-fb053999-8b91-4de7-8d41-6e395c2b57ab tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:09.708909 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-fb053999-8b91-4de7-8d41-6e395c2b57ab tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:09.710329 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-fb053999-8b91-4de7-8d41-6e395c2b57ab tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1655 microversion: 2.20 time: 0.093748 Jul 20 15:40:09.714153 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 447/898] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:40:09 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1655 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:40:10.011522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-71f12eaa-4cc4-4ecb-8e30-0e1bb8770a99 req-eb944c30-d4bb-46e7-a714-2c8c411ffaf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1f04603-2085-4cc0-8263-d9c95c31f8a7", "name": "network-vif-deleted", "tag": "a14d5f16-fe56-45ba-b07b-4affc5762962"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:40:10.021000 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-71f12eaa-4cc4-4ecb-8e30-0e1bb8770a99 req-eb944c30-d4bb-46e7-a714-2c8c411ffaf2 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:10.021518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-71f12eaa-4cc4-4ecb-8e30-0e1bb8770a99 req-eb944c30-d4bb-46e7-a714-2c8c411ffaf2 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:10.033626 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-71f12eaa-4cc4-4ecb-8e30-0e1bb8770a99 req-eb944c30-d4bb-46e7-a714-2c8c411ffaf2 service nova] Creating event network-vif-deleted:a14d5f16-fe56-45ba-b07b-4affc5762962 for instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 on hv-cinder-81914 Jul 20 15:40:10.038529 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-71f12eaa-4cc4-4ecb-8e30-0e1bb8770a99 req-eb944c30-d4bb-46e7-a714-2c8c411ffaf2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031015 Jul 20 15:40:10.039123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 452/899] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:40:10.737738 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-43308cd7-4877-4511-83a7-79c29008d10f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:10.738925 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-43308cd7-4877-4511-83a7-79c29008d10f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:10.746277 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-43308cd7-4877-4511-83a7-79c29008d10f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:10.746745 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-43308cd7-4877-4511-83a7-79c29008d10f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:10.749159 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-43308cd7-4877-4511-83a7-79c29008d10f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:10.749314 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-43308cd7-4877-4511-83a7-79c29008d10f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:10.780990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-43308cd7-4877-4511-83a7-79c29008d10f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:10.781228 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-43308cd7-4877-4511-83a7-79c29008d10f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:10.781684 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.objects.instance [None req-43308cd7-4877-4511-83a7-79c29008d10f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lazy-loading 'fault' on Instance uuid f1f04603-2085-4cc0-8263-d9c95c31f8a7 {{(pid=124711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:40:10.827489 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-43308cd7-4877-4511-83a7-79c29008d10f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:10.836447 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-43308cd7-4877-4511-83a7-79c29008d10f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:10.838129 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-43308cd7-4877-4511-83a7-79c29008d10f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6498ef5c517c4fa4abed90e430936ded', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4446d4a6f4e64ccb8bfd5b3fe6f2127a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:10.839346 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-43308cd7-4877-4511-83a7-79c29008d10f tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 200 len: 1370 microversion: 2.20 time: 0.108334 Jul 20 15:40:10.839996 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 448/900] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:40:10 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 1370 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 15:40:11.858960 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-dd9c2acf-78ef-4ee7-b0a7-6efd1e1f642c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:11.859660 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-dd9c2acf-78ef-4ee7-b0a7-6efd1e1f642c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:11.865910 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dd9c2acf-78ef-4ee7-b0a7-6efd1e1f642c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:11.866401 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dd9c2acf-78ef-4ee7-b0a7-6efd1e1f642c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:11.867165 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dd9c2acf-78ef-4ee7-b0a7-6efd1e1f642c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:11.867605 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dd9c2acf-78ef-4ee7-b0a7-6efd1e1f642c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:11.881045 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-dd9c2acf-78ef-4ee7-b0a7-6efd1e1f642c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] HTTP exception thrown: Instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 could not be found. Jul 20 15:40:11.882714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-dd9c2acf-78ef-4ee7-b0a7-6efd1e1f642c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Request method failure captured: Jul 20 15:40:11.882714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 HTTP/1.1 Jul 20 15:40:11.882714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:40:11.882714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:40:11.882714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:40:11.882714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:40:11.882714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:40:11.882714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:40:11.882714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:40:11.882714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:40:11.882714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2B_tham71lkFjLX120R-m9c9Xg8I1u5NXFR7XRX0lDoiCHu0puQ5EXiCqeCoAfnd0pr4d1p1A4Wtg_FhMOCr-bSRLuze-82So8qSdjlLGkbP_KwkWIEPVJOiXkzFjGjoo2PVspwIuYeREmCvEU13xwSx0aVwgKeL-6IxYKwVbH2jBGU Jul 20 15:40:11.882714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:40:11.882714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:40:11.882714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:40:11.882714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:40:11.882714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 15:40:11.882714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:40:11.882714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:40:11.882714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 4446d4a6f4e64ccb8bfd5b3fe6f2127a Jul 20 15:40:11.882714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-406309550 Jul 20 15:40:11.882714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:40:11.882714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:40:11.890479 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4446d4a6f4e64ccb8bfd5b3fe6f2127a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4446d4a6f4e64ccb8bfd5b3fe6f2127a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4446d4a6f4e64ccb8bfd5b3fe6f2127a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4446d4a6f4e64ccb8bfd5b3fe6f2127a"}]}] Jul 20 15:40:11.890479 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-AttachVolumeShelveTestJSON-406309550 Jul 20 15:40:11.890479 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 4446d4a6f4e64ccb8bfd5b3fe6f2127a Jul 20 15:40:11.890479 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-406309550 Jul 20 15:40:11.890479 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-AttachVolumeShelveTestJSON-406309550-project Jul 20 15:40:11.890479 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:40:11.890479 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:40:11.890479 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: 6498ef5c517c4fa4abed90e430936ded Jul 20 15:40:11.890479 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-AttachVolumeShelveTestJSON-406309550-project Jul 20 15:40:11.890479 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:40:11.890479 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 could not be found. Jul 20 15:40:11.890479 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': 'f1f04603-2085-4cc0-8263-d9c95c31f8a7'} Jul 20 15:40:11.891439 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:40:11.891439 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:11.891439 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:40:11.891439 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:40:11.891439 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:40:11.891439 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:40:11.891439 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:40:11.891439 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:40:11.891439 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:40:11.891439 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:40:11.891439 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 could not be found. Jul 20 15:40:11.891439 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:40:11.891439 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:40:11.891439 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:40:11.891439 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:11.891439 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:40:11.891439 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:40:11.891439 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:40:11.891439 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:40:11.891439 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:40:11.893106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:40:11.893106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:40:11.893106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:40:11.893106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:40:11.893106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:40:11.893106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:40:11.893106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:40:11.893106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 could not be found. Jul 20 15:40:11.893106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:40:11.893106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:40:11.893106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:40:11.893106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:11.893106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:40:11.893106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:40:11.893106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:40:11.893106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:40:11.893106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 could not be found. Jul 20 15:40:11.893106 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:40:11.894530 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-dd9c2acf-78ef-4ee7-b0a7-6efd1e1f642c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Returning 404 to user: Instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:40:11.894530 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-dd9c2acf-78ef-4ee7-b0a7-6efd1e1f642c tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 404 len: 111 microversion: 2.20 time: 0.030562 Jul 20 15:40:11.894530 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 453/901] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:40:11 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 15:40:11.894802 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-96aa6c67-5d02-4022-8994-11b0e2b3c63e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '.version_select at 0x7efd90974a60>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:12.014850 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-96aa6c67-5d02-4022-8994-11b0e2b3c63e tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-317605155" status: 204 len: 0 microversion: 2.20 time: 0.125526 Jul 20 15:40:12.015571 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 449/902] 10.222.0.78 () {60 vars in 1258 bytes} [Wed Jul 20 15:40:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-317605155 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 15:40:14.157322 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-98516e8a-25c9-43e1-95cd-c3f743ffeec5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:14.157804 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-98516e8a-25c9-43e1-95cd-c3f743ffeec5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:14.164294 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-98516e8a-25c9-43e1-95cd-c3f743ffeec5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:14.164735 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-98516e8a-25c9-43e1-95cd-c3f743ffeec5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:14.165488 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-98516e8a-25c9-43e1-95cd-c3f743ffeec5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:14.165920 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-98516e8a-25c9-43e1-95cd-c3f743ffeec5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:14.179783 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-98516e8a-25c9-43e1-95cd-c3f743ffeec5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] HTTP exception thrown: Instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 could not be found. Jul 20 15:40:14.181344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-98516e8a-25c9-43e1-95cd-c3f743ffeec5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Request method failure captured: Jul 20 15:40:14.181344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: DELETE /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 HTTP/1.1 Jul 20 15:40:14.181344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:40:14.181344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:40:14.181344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:40:14.181344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:40:14.181344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:40:14.181344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:40:14.181344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:40:14.181344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:40:14.181344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2B_tham71lkFjLX120R-m9c9Xg8I1u5NXFR7XRX0lDoiCHu0puQ5EXiCqeCoAfnd0pr4d1p1A4Wtg_FhMOCr-bSRLuze-82So8qSdjlLGkbP_KwkWIEPVJOiXkzFjGjoo2PVspwIuYeREmCvEU13xwSx0aVwgKeL-6IxYKwVbH2jBGU Jul 20 15:40:14.181344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:40:14.181344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:40:14.181344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:40:14.181344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:40:14.181344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 15:40:14.181344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:40:14.181344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:40:14.181344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 4446d4a6f4e64ccb8bfd5b3fe6f2127a Jul 20 15:40:14.181344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-406309550 Jul 20 15:40:14.181344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:40:14.181344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:40:14.183042 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4446d4a6f4e64ccb8bfd5b3fe6f2127a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4446d4a6f4e64ccb8bfd5b3fe6f2127a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4446d4a6f4e64ccb8bfd5b3fe6f2127a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4446d4a6f4e64ccb8bfd5b3fe6f2127a"}]}] Jul 20 15:40:14.183042 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-AttachVolumeShelveTestJSON-406309550 Jul 20 15:40:14.183042 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 4446d4a6f4e64ccb8bfd5b3fe6f2127a Jul 20 15:40:14.183042 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-406309550 Jul 20 15:40:14.183042 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-AttachVolumeShelveTestJSON-406309550-project Jul 20 15:40:14.183042 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:40:14.183042 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:40:14.183042 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: 6498ef5c517c4fa4abed90e430936ded Jul 20 15:40:14.183042 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-AttachVolumeShelveTestJSON-406309550-project Jul 20 15:40:14.183042 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:40:14.183042 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 could not be found. Jul 20 15:40:14.183042 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': 'f1f04603-2085-4cc0-8263-d9c95c31f8a7'} Jul 20 15:40:14.183954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:40:14.183954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:14.183954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:40:14.183954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:40:14.183954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:40:14.183954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:40:14.183954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:40:14.183954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:40:14.183954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:40:14.183954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:40:14.183954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 could not be found. Jul 20 15:40:14.183954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:40:14.183954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:40:14.183954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:40:14.183954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:14.183954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:40:14.183954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:40:14.183954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:40:14.183954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:40:14.183954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:40:14.185411 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:40:14.185411 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 15:40:14.185411 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 15:40:14.185411 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 15:40:14.185411 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 15:40:14.185411 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:40:14.185411 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:40:14.185411 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:40:14.185411 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:40:14.185411 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 could not be found. Jul 20 15:40:14.185411 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:40:14.185411 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:40:14.185411 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:40:14.185411 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:14.185411 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:40:14.185411 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:40:14.185411 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:40:14.185411 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:40:14.185411 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 could not be found. Jul 20 15:40:14.185411 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:40:14.187038 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-98516e8a-25c9-43e1-95cd-c3f743ffeec5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Returning 404 to user: Instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:40:14.187038 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-98516e8a-25c9-43e1-95cd-c3f743ffeec5 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 404 len: 111 microversion: 2.20 time: 0.029847 Jul 20 15:40:14.187038 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 454/903] 10.222.0.78 () {60 vars in 1279 bytes} [Wed Jul 20 15:40:14 2022] DELETE /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 15:40:14.191459 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-89e380fb-8f88-457e-806a-e845cc5f2783 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:14.192066 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-89e380fb-8f88-457e-806a-e845cc5f2783 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f1f04603-2085-4cc0-8263-d9c95c31f8a7] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:14.198565 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-89e380fb-8f88-457e-806a-e845cc5f2783 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:14.199009 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-89e380fb-8f88-457e-806a-e845cc5f2783 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:14.199760 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-89e380fb-8f88-457e-806a-e845cc5f2783 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:14.200191 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-89e380fb-8f88-457e-806a-e845cc5f2783 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:14.213183 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-89e380fb-8f88-457e-806a-e845cc5f2783 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] HTTP exception thrown: Instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 could not be found. Jul 20 15:40:14.214843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-89e380fb-8f88-457e-806a-e845cc5f2783 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Request method failure captured: Jul 20 15:40:14.214843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 HTTP/1.1 Jul 20 15:40:14.214843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:40:14.214843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:40:14.214843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:40:14.214843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:40:14.214843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:40:14.214843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:40:14.214843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:40:14.214843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:40:14.214843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2B_tham71lkFjLX120R-m9c9Xg8I1u5NXFR7XRX0lDoiCHu0puQ5EXiCqeCoAfnd0pr4d1p1A4Wtg_FhMOCr-bSRLuze-82So8qSdjlLGkbP_KwkWIEPVJOiXkzFjGjoo2PVspwIuYeREmCvEU13xwSx0aVwgKeL-6IxYKwVbH2jBGU Jul 20 15:40:14.214843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:40:14.214843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:40:14.214843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:40:14.214843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:40:14.214843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 15:40:14.214843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:40:14.214843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:40:14.214843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: 4446d4a6f4e64ccb8bfd5b3fe6f2127a Jul 20 15:40:14.214843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-406309550 Jul 20 15:40:14.214843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:40:14.214843 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:40:14.217111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4446d4a6f4e64ccb8bfd5b3fe6f2127a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4446d4a6f4e64ccb8bfd5b3fe6f2127a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4446d4a6f4e64ccb8bfd5b3fe6f2127a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4446d4a6f4e64ccb8bfd5b3fe6f2127a"}]}] Jul 20 15:40:14.217111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-AttachVolumeShelveTestJSON-406309550 Jul 20 15:40:14.217111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: 4446d4a6f4e64ccb8bfd5b3fe6f2127a Jul 20 15:40:14.217111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-406309550 Jul 20 15:40:14.217111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-AttachVolumeShelveTestJSON-406309550-project Jul 20 15:40:14.217111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:40:14.217111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:40:14.217111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: 6498ef5c517c4fa4abed90e430936ded Jul 20 15:40:14.217111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-AttachVolumeShelveTestJSON-406309550-project Jul 20 15:40:14.217111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: > Jul 20 15:40:14.217111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 could not be found. Jul 20 15:40:14.217111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': 'f1f04603-2085-4cc0-8263-d9c95c31f8a7'} Jul 20 15:40:14.217919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:40:14.217919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:14.217919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:40:14.217919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:40:14.217919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:40:14.217919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:40:14.217919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:40:14.217919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:40:14.217919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:40:14.217919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:40:14.217919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 could not be found. Jul 20 15:40:14.217919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:40:14.217919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:40:14.217919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:40:14.217919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:14.217919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:40:14.217919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:40:14.217919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:40:14.217919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:40:14.217919 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:40:14.219227 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:40:14.219227 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:40:14.219227 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:40:14.219227 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:40:14.219227 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:40:14.219227 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:40:14.219227 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:40:14.219227 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 could not be found. Jul 20 15:40:14.219227 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:40:14.219227 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:40:14.219227 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:40:14.219227 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:14.219227 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:40:14.219227 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:40:14.219227 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:40:14.219227 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:40:14.219227 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 could not be found. Jul 20 15:40:14.219227 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:40:14.220592 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-89e380fb-8f88-457e-806a-e845cc5f2783 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Returning 404 to user: Instance f1f04603-2085-4cc0-8263-d9c95c31f8a7 could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:40:14.220592 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-89e380fb-8f88-457e-806a-e845cc5f2783 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7" status: 404 len: 111 microversion: 2.20 time: 0.029039 Jul 20 15:40:14.220592 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 450/904] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:40:14 2022] GET /compute/v2.1/servers/f1f04603-2085-4cc0-8263-d9c95c31f8a7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 15:40:15.628552 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d1bafd21-fde1-46bb-85ef-4051f5591cac tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:15.629045 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d1bafd21-fde1-46bb-85ef-4051f5591cac tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:15.635485 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d1bafd21-fde1-46bb-85ef-4051f5591cac tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:15.635927 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d1bafd21-fde1-46bb-85ef-4051f5591cac tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:15.636750 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d1bafd21-fde1-46bb-85ef-4051f5591cac tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:15.637185 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d1bafd21-fde1-46bb-85ef-4051f5591cac tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:15.650324 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-d1bafd21-fde1-46bb-85ef-4051f5591cac tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] HTTP exception thrown: Instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 could not be found. Jul 20 15:40:15.651846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d1bafd21-fde1-46bb-85ef-4051f5591cac tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Request method failure captured: Jul 20 15:40:15.651846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: DELETE /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 HTTP/1.1 Jul 20 15:40:15.651846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:40:15.651846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:40:15.651846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:40:15.651846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:40:15.651846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:40:15.651846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:40:15.651846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:40:15.651846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:40:15.651846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2B_tham71lkFjLX120R-m9c9Xg8I1u5NXFR7XRX0lDoiCHu0puQ5EXiCqeCoAfnd0pr4d1p1A4Wtg_FhMOCr-bSRLuze-82So8qSdjlLGkbP_KwkWIEPVJOiXkzFjGjoo2PVspwIuYeREmCvEU13xwSx0aVwgKeL-6IxYKwVbH2jBGU Jul 20 15:40:15.651846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:40:15.651846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:40:15.651846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:40:15.651846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:40:15.651846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 15:40:15.651846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:40:15.651846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:40:15.651846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 4446d4a6f4e64ccb8bfd5b3fe6f2127a Jul 20 15:40:15.651846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-406309550 Jul 20 15:40:15.651846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:40:15.651846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:40:15.653502 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4446d4a6f4e64ccb8bfd5b3fe6f2127a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4446d4a6f4e64ccb8bfd5b3fe6f2127a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4446d4a6f4e64ccb8bfd5b3fe6f2127a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4446d4a6f4e64ccb8bfd5b3fe6f2127a"}]}] Jul 20 15:40:15.653502 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-AttachVolumeShelveTestJSON-406309550 Jul 20 15:40:15.653502 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 4446d4a6f4e64ccb8bfd5b3fe6f2127a Jul 20 15:40:15.653502 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-406309550 Jul 20 15:40:15.653502 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-AttachVolumeShelveTestJSON-406309550-project Jul 20 15:40:15.653502 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:40:15.653502 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:40:15.653502 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: 6498ef5c517c4fa4abed90e430936ded Jul 20 15:40:15.653502 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-AttachVolumeShelveTestJSON-406309550-project Jul 20 15:40:15.653502 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:40:15.653502 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 could not be found. Jul 20 15:40:15.653502 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': 'f4cd0f35-70ba-409d-b217-32d5a9ab6cd6'} Jul 20 15:40:15.654449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:40:15.654449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:15.654449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:40:15.654449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:40:15.654449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:40:15.654449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:40:15.654449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:40:15.654449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:40:15.654449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:40:15.654449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:40:15.654449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 could not be found. Jul 20 15:40:15.654449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:40:15.654449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:40:15.654449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:40:15.654449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:15.654449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:40:15.654449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:40:15.654449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:40:15.654449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:40:15.654449 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:40:15.656451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:40:15.656451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 15:40:15.656451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 15:40:15.656451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 15:40:15.656451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 15:40:15.656451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:40:15.656451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:40:15.656451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:40:15.656451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:40:15.656451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 could not be found. Jul 20 15:40:15.656451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:40:15.656451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:40:15.656451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:40:15.656451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:15.656451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:40:15.656451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:40:15.656451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:40:15.656451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:40:15.656451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 could not be found. Jul 20 15:40:15.656451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:40:15.657959 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d1bafd21-fde1-46bb-85ef-4051f5591cac tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Returning 404 to user: Instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:40:15.657959 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-d1bafd21-fde1-46bb-85ef-4051f5591cac tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 404 len: 111 microversion: 2.20 time: 0.028493 Jul 20 15:40:15.657959 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 455/905] 10.222.0.78 () {60 vars in 1279 bytes} [Wed Jul 20 15:40:15 2022] DELETE /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 20 15:40:15.662130 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-6ed60d3a-291a-4d7b-b84c-9c2d68bd8698 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:15.662781 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-6ed60d3a-291a-4d7b-b84c-9c2d68bd8698 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] [instance: f4cd0f35-70ba-409d-b217-32d5a9ab6cd6] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:15.669311 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6ed60d3a-291a-4d7b-b84c-9c2d68bd8698 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:15.669750 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6ed60d3a-291a-4d7b-b84c-9c2d68bd8698 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:15.671168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6ed60d3a-291a-4d7b-b84c-9c2d68bd8698 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:15.671605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-6ed60d3a-291a-4d7b-b84c-9c2d68bd8698 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:15.684926 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-6ed60d3a-291a-4d7b-b84c-9c2d68bd8698 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] HTTP exception thrown: Instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 could not be found. Jul 20 15:40:15.686614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-6ed60d3a-291a-4d7b-b84c-9c2d68bd8698 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Request method failure captured: Jul 20 15:40:15.686614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 HTTP/1.1 Jul 20 15:40:15.686614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:40:15.686614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:40:15.686614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:40:15.686614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:40:15.686614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:40:15.686614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:40:15.686614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:40:15.686614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:40:15.686614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2B_tham71lkFjLX120R-m9c9Xg8I1u5NXFR7XRX0lDoiCHu0puQ5EXiCqeCoAfnd0pr4d1p1A4Wtg_FhMOCr-bSRLuze-82So8qSdjlLGkbP_KwkWIEPVJOiXkzFjGjoo2PVspwIuYeREmCvEU13xwSx0aVwgKeL-6IxYKwVbH2jBGU Jul 20 15:40:15.686614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:40:15.686614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:40:15.686614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:40:15.686614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:40:15.686614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 15:40:15.686614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:40:15.686614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:40:15.686614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: 4446d4a6f4e64ccb8bfd5b3fe6f2127a Jul 20 15:40:15.686614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-406309550 Jul 20 15:40:15.686614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:40:15.686614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:40:15.688503 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4446d4a6f4e64ccb8bfd5b3fe6f2127a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4446d4a6f4e64ccb8bfd5b3fe6f2127a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4446d4a6f4e64ccb8bfd5b3fe6f2127a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4446d4a6f4e64ccb8bfd5b3fe6f2127a"}]}] Jul 20 15:40:15.688503 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-AttachVolumeShelveTestJSON-406309550 Jul 20 15:40:15.688503 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: 4446d4a6f4e64ccb8bfd5b3fe6f2127a Jul 20 15:40:15.688503 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-406309550 Jul 20 15:40:15.688503 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-AttachVolumeShelveTestJSON-406309550-project Jul 20 15:40:15.688503 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:40:15.688503 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:40:15.688503 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: 6498ef5c517c4fa4abed90e430936ded Jul 20 15:40:15.688503 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-AttachVolumeShelveTestJSON-406309550-project Jul 20 15:40:15.688503 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: > Jul 20 15:40:15.688503 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 could not be found. Jul 20 15:40:15.688503 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': 'f4cd0f35-70ba-409d-b217-32d5a9ab6cd6'} Jul 20 15:40:15.689406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:40:15.689406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:15.689406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:40:15.689406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:40:15.689406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:40:15.689406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:40:15.689406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:40:15.689406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:40:15.689406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:40:15.689406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:40:15.689406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 could not be found. Jul 20 15:40:15.689406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:40:15.689406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:40:15.689406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:40:15.689406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:15.689406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:40:15.689406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:40:15.689406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:40:15.689406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:40:15.689406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:40:15.690911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:40:15.690911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:40:15.690911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:40:15.690911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:40:15.690911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:40:15.690911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:40:15.690911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:40:15.690911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 could not be found. Jul 20 15:40:15.690911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:40:15.690911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:40:15.690911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:40:15.690911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:15.690911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:40:15.690911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:40:15.690911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:40:15.690911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:40:15.690911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 could not be found. Jul 20 15:40:15.690911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:40:15.692411 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-6ed60d3a-291a-4d7b-b84c-9c2d68bd8698 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] Returning 404 to user: Instance f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:40:15.692411 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-6ed60d3a-291a-4d7b-b84c-9c2d68bd8698 tempest-AttachVolumeShelveTestJSON-406309550 tempest-AttachVolumeShelveTestJSON-406309550-project] 10.222.0.78 "GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6" status: 404 len: 111 microversion: 2.20 time: 0.029915 Jul 20 15:40:15.692411 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 451/906] 10.222.0.78 () {60 vars in 1276 bytes} [Wed Jul 20 15:40:15 2022] GET /compute/v2.1/servers/f4cd0f35-70ba-409d-b217-32d5a9ab6cd6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 15:40:26.601200 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-91acaf5b-e7b7-4fef-be60-85075934939c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:26.601856 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-91acaf5b-e7b7-4fef-be60-85075934939c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:26.606698 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:40:26.606698 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:40:26.616861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-91acaf5b-e7b7-4fef-be60-85075934939c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:26.617340 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-91acaf5b-e7b7-4fef-be60-85075934939c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:26.618125 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-91acaf5b-e7b7-4fef-be60-85075934939c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:26.619058 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-91acaf5b-e7b7-4fef-be60-85075934939c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:26.647543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-91acaf5b-e7b7-4fef-be60-85075934939c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74/ips" status: 200 len: 148 microversion: 2.1 time: 0.047975 Jul 20 15:40:26.647543 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 456/907] 10.222.0.78 () {58 vars in 1247 bytes} [Wed Jul 20 15:40:26 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74/ips => generated 148 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:40:26.657173 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-18d2ac3c-2dd6-4c13-9290-0ee57c89dbdc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df057e20-4c8a-4c1e-a088-bf16eda0c826"}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:40:26.658243 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-18d2ac3c-2dd6-4c13-9290-0ee57c89dbdc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:26.661562 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:40:26.662197 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=30 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:40:26.665588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-18d2ac3c-2dd6-4c13-9290-0ee57c89dbdc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:26.666030 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-18d2ac3c-2dd6-4c13-9290-0ee57c89dbdc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:26.666819 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-18d2ac3c-2dd6-4c13-9290-0ee57c89dbdc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:26.667253 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-18d2ac3c-2dd6-4c13-9290-0ee57c89dbdc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:26.745331 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-18d2ac3c-2dd6-4c13-9290-0ee57c89dbdc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] HTTP exception thrown: Invalid volume: volume df057e20-4c8a-4c1e-a088-bf16eda0c826 is already attached to instances: b0789091-c337-4b8d-b1b5-02144d153dcc Jul 20 15:40:26.747209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-18d2ac3c-2dd6-4c13-9290-0ee57c89dbdc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Request method failure captured: Jul 20 15:40:26.747209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: POST /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74/os-volume_attachments HTTP/1.1 Jul 20 15:40:26.747209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:40:26.747209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:40:26.747209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:40:26.747209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 74 Jul 20 15:40:26.747209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:40:26.747209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:40:26.747209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:40:26.747209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:40:26.747209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2CFbqu0igtNFkKl4EJaf-GYNIGNf3oPPBh1qR18PSUtcU3V7h-gnPvG3ab7Q5raWMuBmdNqsnWfQ6CrhGLfn4khb0o1UjxQU3L4Zqn7IpPmYId2n8OkZqafcLgphEQCenF6dSjPlKmYhLi2C6LeB66jmX3oFU2bTLIqjrnHhkVSptBA Jul 20 15:40:26.747209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:40:26.747209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:40:26.747209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:40:26.747209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:40:26.747209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:40:26.747209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:40:26.747209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:40:26.747209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:40:26.747209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:40:26.747209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:40:26.748994 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dc2a5c754d42d1862b331afef2183f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}] Jul 20 15:40:26.748994 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:40:26.748994 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:40:26.748994 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:40:26.748994 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:40:26.748994 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:40:26.748994 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:40:26.748994 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: 0235b8fe92554131ba30e1d18f0f2d86 Jul 20 15:40:26.748994 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:40:26.748994 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Jul 20 15:40:26.748994 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {"volumeAttachment": {"volumeId": "df057e20-4c8a-4c1e-a088-bf16eda0c826"}} Jul 20 15:40:26.748994 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: > Jul 20 15:40:26.750164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Invalid volume: volume df057e20-4c8a-4c1e-a088-bf16eda0c826 is already attached to instances: b0789091-c337-4b8d-b1b5-02144d153dcc Jul 20 15:40:26.750164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'server_id': '84c1c67f-27a0-475d-9897-10786bf0bc74', 'body': {'volumeAttachment': {'volumeId': 'df057e20-4c8a-4c1e-a088-bf16eda0c826'}}} Jul 20 15:40:26.750164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:40:26.750164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:26.750164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 15:40:26.750164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 15:40:26.750164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 15:40:26.750164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 15:40:26.750164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 15:40:26.750164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 15:40:26.750164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 15:40:26.750164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 15:40:26.750164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 15:40:26.750164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 15:40:26.750164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume df057e20-4c8a-4c1e-a088-bf16eda0c826 is already attached to instances: b0789091-c337-4b8d-b1b5-02144d153dcc Jul 20 15:40:26.750164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:40:26.750164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:40:26.750164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:40:26.750164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:26.751751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:40:26.751751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:40:26.751751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:40:26.751751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:40:26.751751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:40:26.751751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:40:26.751751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 15:40:26.751751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 15:40:26.751751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 15:40:26.751751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 15:40:26.751751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 15:40:26.751751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 15:40:26.751751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 15:40:26.751751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 15:40:26.751751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume df057e20-4c8a-4c1e-a088-bf16eda0c826 is already attached to instances: b0789091-c337-4b8d-b1b5-02144d153dcc Jul 20 15:40:26.751751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:40:26.751751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:40:26.751751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:40:26.751751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:26.751751 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:40:26.753344 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:40:26.753344 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:40:26.753344 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:40:26.753344 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume df057e20-4c8a-4c1e-a088-bf16eda0c826 is already attached to instances: b0789091-c337-4b8d-b1b5-02144d153dcc Jul 20 15:40:26.753344 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:40:26.753344 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-18d2ac3c-2dd6-4c13-9290-0ee57c89dbdc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Returning 400 to user: Invalid volume: volume df057e20-4c8a-4c1e-a088-bf16eda0c826 is already attached to instances: b0789091-c337-4b8d-b1b5-02144d153dcc {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:40:26.753344 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-18d2ac3c-2dd6-4c13-9290-0ee57c89dbdc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "POST /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096236 Jul 20 15:40:26.753344 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 452/908] 10.222.0.78 () {60 vars in 1322 bytes} [Wed Jul 20 15:40:26 2022] POST /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 15:40:26.757656 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-8c63e597-0e3e-4d67-9b58-2dbd75314d6f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:26.758159 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-8c63e597-0e3e-4d67-9b58-2dbd75314d6f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:26.765831 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8c63e597-0e3e-4d67-9b58-2dbd75314d6f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:26.768152 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8c63e597-0e3e-4d67-9b58-2dbd75314d6f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:26.768152 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8c63e597-0e3e-4d67-9b58-2dbd75314d6f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:26.768152 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8c63e597-0e3e-4d67-9b58-2dbd75314d6f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:26.792138 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-8c63e597-0e3e-4d67-9b58-2dbd75314d6f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Going to try to terminate instance {{(pid=124712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 15:40:27.175913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-8c63e597-0e3e-4d67-9b58-2dbd75314d6f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "DELETE /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 204 len: 0 microversion: 2.1 time: 0.422142 Jul 20 15:40:27.176580 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 457/909] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:40:26 2022] DELETE /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 15:40:27.185198 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-71e37181-69cf-4ee5-b999-56b6c9eb119d tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:27.186974 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-71e37181-69cf-4ee5-b999-56b6c9eb119d tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:27.193943 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-71e37181-69cf-4ee5-b999-56b6c9eb119d tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:27.194429 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-71e37181-69cf-4ee5-b999-56b6c9eb119d tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:27.195268 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-71e37181-69cf-4ee5-b999-56b6c9eb119d tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:27.195700 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-71e37181-69cf-4ee5-b999-56b6c9eb119d tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:27.342368 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-71e37181-69cf-4ee5-b999-56b6c9eb119d tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:27.351892 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-71e37181-69cf-4ee5-b999-56b6c9eb119d tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 200 len: 1679 microversion: 2.1 time: 0.170615 Jul 20 15:40:27.352711 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 453/910] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:40:27 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:40:28.369467 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-f2554547-8f0a-4aee-bc6c-42c5ff6a9bc4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:28.370638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-f2554547-8f0a-4aee-bc6c-42c5ff6a9bc4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:28.376630 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f2554547-8f0a-4aee-bc6c-42c5ff6a9bc4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:28.377075 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f2554547-8f0a-4aee-bc6c-42c5ff6a9bc4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:28.377966 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f2554547-8f0a-4aee-bc6c-42c5ff6a9bc4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:28.378484 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f2554547-8f0a-4aee-bc6c-42c5ff6a9bc4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:28.512171 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-f2554547-8f0a-4aee-bc6c-42c5ff6a9bc4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:28.520576 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-f2554547-8f0a-4aee-bc6c-42c5ff6a9bc4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 200 len: 1679 microversion: 2.1 time: 0.155309 Jul 20 15:40:28.521147 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 458/911] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:40:28 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:40:29.496849 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-516d76cf-ca6a-4f60-96cf-4a94c5a0d3fe req-bbe3b1f1-8eea-4af2-804b-21e8f65db5a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84c1c67f-27a0-475d-9897-10786bf0bc74", "name": "network-vif-deleted", "tag": "4be42035-ca2a-44b6-8ef1-f43eab23bd03"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:40:29.507161 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-516d76cf-ca6a-4f60-96cf-4a94c5a0d3fe req-bbe3b1f1-8eea-4af2-804b-21e8f65db5a2 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:29.509614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-516d76cf-ca6a-4f60-96cf-4a94c5a0d3fe req-bbe3b1f1-8eea-4af2-804b-21e8f65db5a2 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:29.519848 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-516d76cf-ca6a-4f60-96cf-4a94c5a0d3fe req-bbe3b1f1-8eea-4af2-804b-21e8f65db5a2 service nova] Creating event network-vif-deleted:4be42035-ca2a-44b6-8ef1-f43eab23bd03 for instance 84c1c67f-27a0-475d-9897-10786bf0bc74 on hv-cinder-81914 Jul 20 15:40:29.524885 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-516d76cf-ca6a-4f60-96cf-4a94c5a0d3fe req-bbe3b1f1-8eea-4af2-804b-21e8f65db5a2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033530 Jul 20 15:40:29.525471 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 454/912] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:40:29.538333 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-cf4c8279-aade-4acc-ad40-aa50f2d2e7d4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:29.538333 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-cf4c8279-aade-4acc-ad40-aa50f2d2e7d4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:29.552196 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cf4c8279-aade-4acc-ad40-aa50f2d2e7d4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:29.552786 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cf4c8279-aade-4acc-ad40-aa50f2d2e7d4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:29.555970 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cf4c8279-aade-4acc-ad40-aa50f2d2e7d4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:29.556531 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cf4c8279-aade-4acc-ad40-aa50f2d2e7d4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:29.637030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-cf4c8279-aade-4acc-ad40-aa50f2d2e7d4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:29.645967 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-cf4c8279-aade-4acc-ad40-aa50f2d2e7d4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 200 len: 1611 microversion: 2.1 time: 0.112221 Jul 20 15:40:29.647227 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 459/913] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:40:29 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 1611 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:40:30.665612 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-44902b35-db75-4028-bbf8-57fe905d1c74 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:30.666349 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-44902b35-db75-4028-bbf8-57fe905d1c74 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:30.672578 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-44902b35-db75-4028-bbf8-57fe905d1c74 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:30.677570 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-44902b35-db75-4028-bbf8-57fe905d1c74 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:30.677570 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-44902b35-db75-4028-bbf8-57fe905d1c74 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:30.677570 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-44902b35-db75-4028-bbf8-57fe905d1c74 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:30.689807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-44902b35-db75-4028-bbf8-57fe905d1c74 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] HTTP exception thrown: Instance 84c1c67f-27a0-475d-9897-10786bf0bc74 could not be found. Jul 20 15:40:30.690924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-44902b35-db75-4028-bbf8-57fe905d1c74 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Request method failure captured: Jul 20 15:40:30.690924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 HTTP/1.1 Jul 20 15:40:30.690924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:40:30.690924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:40:30.690924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:40:30.690924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:40:30.690924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:40:30.690924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:40:30.690924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:40:30.690924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:40:30.690924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2CFbqu0igtNFkKl4EJaf-GYNIGNf3oPPBh1qR18PSUtcU3V7h-gnPvG3ab7Q5raWMuBmdNqsnWfQ6CrhGLfn4khb0o1UjxQU3L4Zqn7IpPmYId2n8OkZqafcLgphEQCenF6dSjPlKmYhLi2C6LeB66jmX3oFU2bTLIqjrnHhkVSptBA Jul 20 15:40:30.690924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:40:30.690924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:40:30.690924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:40:30.690924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:40:30.690924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:40:30.690924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:40:30.690924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:40:30.690924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:40:30.690924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:40:30.690924 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:40:30.692442 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dc2a5c754d42d1862b331afef2183f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}] Jul 20 15:40:30.692442 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:40:30.692442 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:40:30.692442 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:40:30.692442 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:40:30.692442 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:40:30.692442 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:40:30.692442 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: 0235b8fe92554131ba30e1d18f0f2d86 Jul 20 15:40:30.692442 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:40:30.692442 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: > Jul 20 15:40:30.692442 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Instance 84c1c67f-27a0-475d-9897-10786bf0bc74 could not be found. Jul 20 15:40:30.692442 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': '84c1c67f-27a0-475d-9897-10786bf0bc74'} Jul 20 15:40:30.693327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:40:30.693327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:30.693327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:40:30.693327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:40:30.693327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:40:30.693327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:40:30.693327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:40:30.693327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:40:30.693327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:40:30.693327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:40:30.693327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84c1c67f-27a0-475d-9897-10786bf0bc74 could not be found. Jul 20 15:40:30.693327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:40:30.693327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:40:30.693327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:40:30.693327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:30.693327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:40:30.693327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:40:30.693327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:40:30.693327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:40:30.693327 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:40:30.695003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:40:30.695003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:40:30.695003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:40:30.695003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:40:30.695003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:40:30.695003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:40:30.695003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:40:30.695003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84c1c67f-27a0-475d-9897-10786bf0bc74 could not be found. Jul 20 15:40:30.695003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:40:30.695003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:40:30.695003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:40:30.695003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:30.695003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:40:30.695003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:40:30.695003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:40:30.695003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:40:30.695003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84c1c67f-27a0-475d-9897-10786bf0bc74 could not be found. Jul 20 15:40:30.695003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:40:30.697009 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-44902b35-db75-4028-bbf8-57fe905d1c74 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Returning 404 to user: Instance 84c1c67f-27a0-475d-9897-10786bf0bc74 could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:40:30.697009 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-44902b35-db75-4028-bbf8-57fe905d1c74 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 404 len: 111 microversion: 2.1 time: 0.031486 Jul 20 15:40:30.697009 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 455/914] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:40:30 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:40:30.702507 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-1383aebf-3a47-4b3e-8688-ba09f6d2b0bb tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '.version_select at 0x7efd9084eaf0>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:30.833026 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-1383aebf-3a47-4b3e-8688-ba09f6d2b0bb tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-24852007" status: 202 len: 0 microversion: 2.1 time: 0.135070 Jul 20 15:40:30.833771 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 460/915] 10.222.0.78 () {58 vars in 1214 bytes} [Wed Jul 20 15:40:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-24852007 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:40:31.660996 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e3f10ed7-a250-437f-b1da-1ee2425b015b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:31.661539 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e3f10ed7-a250-437f-b1da-1ee2425b015b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:31.667877 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e3f10ed7-a250-437f-b1da-1ee2425b015b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:31.668463 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e3f10ed7-a250-437f-b1da-1ee2425b015b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:31.669034 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e3f10ed7-a250-437f-b1da-1ee2425b015b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:31.669459 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e3f10ed7-a250-437f-b1da-1ee2425b015b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:31.759188 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.objects.instance [None req-e3f10ed7-a250-437f-b1da-1ee2425b015b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lazy-loading 'services' on Instance uuid b0789091-c337-4b8d-b1b5-02144d153dcc {{(pid=124711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:40:32.020061 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e3f10ed7-a250-437f-b1da-1ee2425b015b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc/os-volume_attachments/df057e20-4c8a-4c1e-a088-bf16eda0c826" status: 202 len: 0 microversion: 2.1 time: 0.362757 Jul 20 15:40:32.020832 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 456/916] 10.222.0.78 () {58 vars in 1415 bytes} [Wed Jul 20 15:40:31 2022] DELETE /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc/os-volume_attachments/df057e20-4c8a-4c1e-a088-bf16eda0c826 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:40:32.029667 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-4fea203b-f32b-4d3b-b35c-2199234ca300 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:32.030620 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-4fea203b-f32b-4d3b-b35c-2199234ca300 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:32.037272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4fea203b-f32b-4d3b-b35c-2199234ca300 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:32.037715 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4fea203b-f32b-4d3b-b35c-2199234ca300 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:32.038520 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4fea203b-f32b-4d3b-b35c-2199234ca300 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:32.038952 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4fea203b-f32b-4d3b-b35c-2199234ca300 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:32.068104 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-4fea203b-f32b-4d3b-b35c-2199234ca300 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042863 Jul 20 15:40:32.068661 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 461/917] 10.222.0.78 () {58 vars in 1301 bytes} [Wed Jul 20 15:40:32 2022] GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:40:33.080795 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c37caa38-7e45-4051-a109-a083ffe7eeb2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:33.082010 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c37caa38-7e45-4051-a109-a083ffe7eeb2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:33.088703 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c37caa38-7e45-4051-a109-a083ffe7eeb2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:33.089180 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c37caa38-7e45-4051-a109-a083ffe7eeb2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:33.093108 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c37caa38-7e45-4051-a109-a083ffe7eeb2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:33.093108 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c37caa38-7e45-4051-a109-a083ffe7eeb2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:33.126209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c37caa38-7e45-4051-a109-a083ffe7eeb2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049719 Jul 20 15:40:33.127016 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 457/918] 10.222.0.78 () {58 vars in 1301 bytes} [Wed Jul 20 15:40:33 2022] GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 15:40:33.187422 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-af10db59-0fd3-4812-adcb-b6ac6c142183 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:33.191304 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-af10db59-0fd3-4812-adcb-b6ac6c142183 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:33.194473 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-af10db59-0fd3-4812-adcb-b6ac6c142183 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:33.194926 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-af10db59-0fd3-4812-adcb-b6ac6c142183 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:33.195686 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-af10db59-0fd3-4812-adcb-b6ac6c142183 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:33.196122 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-af10db59-0fd3-4812-adcb-b6ac6c142183 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:33.221496 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-af10db59-0fd3-4812-adcb-b6ac6c142183 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Going to try to terminate instance {{(pid=124712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 15:40:33.559558 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-af10db59-0fd3-4812-adcb-b6ac6c142183 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc" status: 204 len: 0 microversion: 2.1 time: 0.375738 Jul 20 15:40:33.560222 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 462/919] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:40:33 2022] DELETE /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 15:40:33.569104 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ce3fe3d1-45c6-4428-be07-f9c0301e8b8b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:33.569710 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ce3fe3d1-45c6-4428-be07-f9c0301e8b8b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:33.576993 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ce3fe3d1-45c6-4428-be07-f9c0301e8b8b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:33.577696 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ce3fe3d1-45c6-4428-be07-f9c0301e8b8b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:33.578746 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ce3fe3d1-45c6-4428-be07-f9c0301e8b8b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:33.579227 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ce3fe3d1-45c6-4428-be07-f9c0301e8b8b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:33.713964 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-ce3fe3d1-45c6-4428-be07-f9c0301e8b8b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:33.722238 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-ce3fe3d1-45c6-4428-be07-f9c0301e8b8b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc" status: 200 len: 1682 microversion: 2.1 time: 0.156908 Jul 20 15:40:33.722848 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 458/920] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:40:33 2022] GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:40:34.739883 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-0e2eed0c-df3b-4f1e-9d38-b8199e085caa tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:34.740534 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-0e2eed0c-df3b-4f1e-9d38-b8199e085caa tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:34.747036 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0e2eed0c-df3b-4f1e-9d38-b8199e085caa tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:34.747489 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0e2eed0c-df3b-4f1e-9d38-b8199e085caa tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:34.748752 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0e2eed0c-df3b-4f1e-9d38-b8199e085caa tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:34.749184 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0e2eed0c-df3b-4f1e-9d38-b8199e085caa tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:34.886000 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-0e2eed0c-df3b-4f1e-9d38-b8199e085caa tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:34.898407 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-0e2eed0c-df3b-4f1e-9d38-b8199e085caa tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc" status: 200 len: 1682 microversion: 2.1 time: 0.158194 Jul 20 15:40:34.898407 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 463/921] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:40:34 2022] GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:40:35.910344 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-7490605f-a2cf-45ea-885e-dd980f837246 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:35.910952 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-7490605f-a2cf-45ea-885e-dd980f837246 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:35.917610 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7490605f-a2cf-45ea-885e-dd980f837246 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:35.918054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7490605f-a2cf-45ea-885e-dd980f837246 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:35.918848 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7490605f-a2cf-45ea-885e-dd980f837246 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:35.919281 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7490605f-a2cf-45ea-885e-dd980f837246 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:35.984219 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-7490605f-a2cf-45ea-885e-dd980f837246 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:35.996730 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-7490605f-a2cf-45ea-885e-dd980f837246 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc" status: 200 len: 1614 microversion: 2.1 time: 0.090283 Jul 20 15:40:36.007551 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 459/922] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:40:35 2022] GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc => generated 1614 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:40:36.047462 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-1ac02234-0771-4d1f-9a82-22d023c8a984 req-e66763c4-d0bc-4027-bdd9-a420a0a06fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0789091-c337-4b8d-b1b5-02144d153dcc", "name": "network-vif-deleted", "tag": "8f52bdd8-fb43-4258-ab4f-f2f957867c30"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:40:36.065757 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-1ac02234-0771-4d1f-9a82-22d023c8a984 req-e66763c4-d0bc-4027-bdd9-a420a0a06fb7 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:36.067138 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-1ac02234-0771-4d1f-9a82-22d023c8a984 req-e66763c4-d0bc-4027-bdd9-a420a0a06fb7 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:36.080441 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-1ac02234-0771-4d1f-9a82-22d023c8a984 req-e66763c4-d0bc-4027-bdd9-a420a0a06fb7 service nova] Creating event network-vif-deleted:8f52bdd8-fb43-4258-ab4f-f2f957867c30 for instance b0789091-c337-4b8d-b1b5-02144d153dcc on hv-cinder-81914 Jul 20 15:40:36.085559 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-1ac02234-0771-4d1f-9a82-22d023c8a984 req-e66763c4-d0bc-4027-bdd9-a420a0a06fb7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041755 Jul 20 15:40:36.087419 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 464/923] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:40:37.019901 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-0075ae75-768a-46ea-96fa-ac58a32c3071 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:37.020339 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-0075ae75-768a-46ea-96fa-ac58a32c3071 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:37.027554 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0075ae75-768a-46ea-96fa-ac58a32c3071 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:37.028093 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0075ae75-768a-46ea-96fa-ac58a32c3071 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:37.028954 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0075ae75-768a-46ea-96fa-ac58a32c3071 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:37.029478 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0075ae75-768a-46ea-96fa-ac58a32c3071 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:37.065931 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0075ae75-768a-46ea-96fa-ac58a32c3071 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:37.066423 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0075ae75-768a-46ea-96fa-ac58a32c3071 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:37.067062 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.objects.instance [None req-0075ae75-768a-46ea-96fa-ac58a32c3071 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lazy-loading 'fault' on Instance uuid b0789091-c337-4b8d-b1b5-02144d153dcc {{(pid=124711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:40:37.110619 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-0075ae75-768a-46ea-96fa-ac58a32c3071 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:37.123859 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-0075ae75-768a-46ea-96fa-ac58a32c3071 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc" status: 200 len: 1331 microversion: 2.1 time: 0.111134 Jul 20 15:40:37.125796 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 460/924] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:40:37 2022] GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:40:38.146220 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-716df792-828f-42f7-a732-e71861dd8e4b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:38.146949 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-716df792-828f-42f7-a732-e71861dd8e4b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:38.154807 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-716df792-828f-42f7-a732-e71861dd8e4b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:38.155265 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-716df792-828f-42f7-a732-e71861dd8e4b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:38.156025 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-716df792-828f-42f7-a732-e71861dd8e4b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:38.156458 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-716df792-828f-42f7-a732-e71861dd8e4b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:38.169820 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-716df792-828f-42f7-a732-e71861dd8e4b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] HTTP exception thrown: Instance b0789091-c337-4b8d-b1b5-02144d153dcc could not be found. Jul 20 15:40:38.171472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-716df792-828f-42f7-a732-e71861dd8e4b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Request method failure captured: Jul 20 15:40:38.171472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc HTTP/1.1 Jul 20 15:40:38.171472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:40:38.171472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:40:38.171472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:40:38.171472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:40:38.171472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:40:38.171472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:40:38.171472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:40:38.171472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:40:38.171472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2CFbqu0igtNFkKl4EJaf-GYNIGNf3oPPBh1qR18PSUtcU3V7h-gnPvG3ab7Q5raWMuBmdNqsnWfQ6CrhGLfn4khb0o1UjxQU3L4Zqn7IpPmYId2n8OkZqafcLgphEQCenF6dSjPlKmYhLi2C6LeB66jmX3oFU2bTLIqjrnHhkVSptBA Jul 20 15:40:38.171472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:40:38.171472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:40:38.171472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:40:38.171472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:40:38.171472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:40:38.171472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:40:38.171472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:40:38.171472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:40:38.171472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:40:38.171472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:40:38.173317 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dc2a5c754d42d1862b331afef2183f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}] Jul 20 15:40:38.173317 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:40:38.173317 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:40:38.173317 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:40:38.173317 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:40:38.173317 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:40:38.173317 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:40:38.173317 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: 0235b8fe92554131ba30e1d18f0f2d86 Jul 20 15:40:38.173317 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:40:38.173317 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:40:38.173317 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance b0789091-c337-4b8d-b1b5-02144d153dcc could not be found. Jul 20 15:40:38.173317 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': 'b0789091-c337-4b8d-b1b5-02144d153dcc'} Jul 20 15:40:38.174579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:40:38.174579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:38.174579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:40:38.174579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:40:38.174579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:40:38.174579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:40:38.174579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:40:38.174579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:40:38.174579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:40:38.174579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:40:38.174579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0789091-c337-4b8d-b1b5-02144d153dcc could not be found. Jul 20 15:40:38.174579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:40:38.174579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:40:38.174579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:40:38.174579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:38.174579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:40:38.174579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:40:38.174579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:40:38.174579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:40:38.174579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:40:38.176202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:40:38.176202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:40:38.176202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:40:38.176202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:40:38.176202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:40:38.176202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:40:38.176202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:40:38.176202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0789091-c337-4b8d-b1b5-02144d153dcc could not be found. Jul 20 15:40:38.176202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:40:38.176202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:40:38.176202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:40:38.176202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:40:38.176202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:40:38.176202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:40:38.176202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:40:38.176202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:40:38.176202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0789091-c337-4b8d-b1b5-02144d153dcc could not be found. Jul 20 15:40:38.176202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:40:38.177907 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-716df792-828f-42f7-a732-e71861dd8e4b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Returning 404 to user: Instance b0789091-c337-4b8d-b1b5-02144d153dcc could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:40:38.177907 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-716df792-828f-42f7-a732-e71861dd8e4b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc" status: 404 len: 111 microversion: 2.1 time: 0.030956 Jul 20 15:40:38.177907 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 465/925] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:40:38 2022] GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:40:38.181973 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-da833cec-4c5e-45e4-a264-4e1fef6c068d tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '.version_select at 0x7efd90985dc0>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:38.314223 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-da833cec-4c5e-45e4-a264-4e1fef6c068d tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-240788742" status: 202 len: 0 microversion: 2.1 time: 0.136087 Jul 20 15:40:38.315058 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 461/926] 10.222.0.78 () {58 vars in 1217 bytes} [Wed Jul 20 15:40:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-240788742 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:40:39.224495 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-fd18c1d1-02e9-4a05-9a52-fd5d862e9bc7 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Action: 'create', calling method: .version_select at 0x7efd9095bf70>, body: {"keypair": {"name": "tempest-keypair-1699995310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKyAo/bYnHPxY//YPFoXNbbnz1EIYe702lkMZDbzNnvwwRmiJGHoVXEDuxGic94+U3VvHaHBZJsuzhYrmeuqHC/7PzeoOcmCRmk0mn8neIaaV6wSs2w8Tliryf6tXKtYBw=="}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:40:39.244452 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-fd18c1d1-02e9-4a05-9a52-fd5d862e9bc7 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Getting quotas for project 44dc2a5c754d42d1862b331afef2183f. Resources: {'key_pairs'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:40:39.245924 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-fd18c1d1-02e9-4a05-9a52-fd5d862e9bc7 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Getting quotas for user 0235b8fe92554131ba30e1d18f0f2d86 and project 44dc2a5c754d42d1862b331afef2183f. Resources: {'key_pairs'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:40:39.406116 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-fd18c1d1-02e9-4a05-9a52-fd5d862e9bc7 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.185401 Jul 20 15:40:39.406778 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 466/927] 10.222.0.78 () {60 vars in 1158 bytes} [Wed Jul 20 15:40:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:40:42.399755 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-804b0177-1ba2-4350-bf07-7f3289815116 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-107770425", "imageRef": "80914b1c-623c-42a8-810e-836b2cce0d3b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c0af21f-0efa-47e6-8a0b-19b7c3e7c8bc"}], "security_groups": [{"name": "tempest-securitygroup--112927386"}], "key_name": "tempest-keypair-1699995310", "user_data": "}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:40:42.511093 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.network.neutron [None req-804b0177-1ba2-4350-bf07-7f3289815116 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] validate_networks() for [('4c0af21f-0efa-47e6-8a0b-19b7c3e7c8bc', None, None, None, None, None)] {{(pid=124711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 15:40:42.899895 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-804b0177-1ba2-4350-bf07-7f3289815116 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Flavor limits 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 15:40:42.900422 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-804b0177-1ba2-4350-bf07-7f3289815116 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Image limits 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 15:40:42.901132 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-804b0177-1ba2-4350-bf07-7f3289815116 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Flavor pref 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 15:40:42.901690 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-804b0177-1ba2-4350-bf07-7f3289815116 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Image pref 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 15:40:42.902339 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-804b0177-1ba2-4350-bf07-7f3289815116 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 15:40:42.912421 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-804b0177-1ba2-4350-bf07-7f3289815116 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:42.912892 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-804b0177-1ba2-4350-bf07-7f3289815116 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:42.913687 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-804b0177-1ba2-4350-bf07-7f3289815116 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:42.914125 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-804b0177-1ba2-4350-bf07-7f3289815116 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:42.930640 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-804b0177-1ba2-4350-bf07-7f3289815116 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Getting quotas for project 44dc2a5c754d42d1862b331afef2183f. Resources: {'instances', 'ram', 'cores'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:40:42.934928 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-804b0177-1ba2-4350-bf07-7f3289815116 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Getting quotas for user 0235b8fe92554131ba30e1d18f0f2d86 and project 44dc2a5c754d42d1862b331afef2183f. Resources: {'instances', 'ram', 'cores'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:40:42.946442 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-804b0177-1ba2-4350-bf07-7f3289815116 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Going to run 1 instances... {{(pid=124711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 15:40:42.948731 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-804b0177-1ba2-4350-bf07-7f3289815116 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80914b1c-623c-42a8-810e-836b2cce0d3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 15:40:43.258106 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-804b0177-1ba2-4350-bf07-7f3289815116 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.863638 Jul 20 15:40:43.264091 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 462/928] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Jul 20 15:40:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 15:40:43.269504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-6635a1fa-c3df-42de-a205-609102f764a2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:43.270373 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-6635a1fa-c3df-42de-a205-609102f764a2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:43.327477 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-6635a1fa-c3df-42de-a205-609102f764a2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:43.334860 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-6635a1fa-c3df-42de-a205-609102f764a2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade" status: 200 len: 1241 microversion: 2.1 time: 0.069446 Jul 20 15:40:43.335513 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 467/929] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:40:43 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:40:44.352363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-bae34819-d9de-45ab-bce9-48e636a78ed5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:44.352884 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-bae34819-d9de-45ab-bce9-48e636a78ed5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:44.406112 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-bae34819-d9de-45ab-bce9-48e636a78ed5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:44.412821 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-bae34819-d9de-45ab-bce9-48e636a78ed5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade" status: 200 len: 1241 microversion: 2.1 time: 0.064818 Jul 20 15:40:44.413381 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 463/930] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:40:44 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:40:45.430475 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-4d967bd5-445c-4c45-aa9b-d872369bbdc1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:45.431020 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-4d967bd5-445c-4c45-aa9b-d872369bbdc1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:45.438534 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4d967bd5-445c-4c45-aa9b-d872369bbdc1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:45.439003 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4d967bd5-445c-4c45-aa9b-d872369bbdc1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:45.439754 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4d967bd5-445c-4c45-aa9b-d872369bbdc1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:45.440190 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4d967bd5-445c-4c45-aa9b-d872369bbdc1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:45.506289 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4d967bd5-445c-4c45-aa9b-d872369bbdc1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:45.514820 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-4d967bd5-445c-4c45-aa9b-d872369bbdc1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade" status: 200 len: 1237 microversion: 2.1 time: 0.088377 Jul 20 15:40:45.515393 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 468/931] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:40:45 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:40:46.532173 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-4fe36534-5a41-4946-b8eb-4078db738363 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:46.532818 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-4fe36534-5a41-4946-b8eb-4078db738363 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:46.541412 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4fe36534-5a41-4946-b8eb-4078db738363 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:46.541869 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4fe36534-5a41-4946-b8eb-4078db738363 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:46.542655 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4fe36534-5a41-4946-b8eb-4078db738363 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:46.543092 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4fe36534-5a41-4946-b8eb-4078db738363 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:46.611781 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-4fe36534-5a41-4946-b8eb-4078db738363 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:46.619909 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-4fe36534-5a41-4946-b8eb-4078db738363 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade" status: 200 len: 1311 microversion: 2.1 time: 0.091579 Jul 20 15:40:46.628382 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 464/932] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:40:46 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:40:47.639451 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-2831a4c5-ec28-4c5f-be3d-84fa53248570 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:47.640071 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-2831a4c5-ec28-4c5f-be3d-84fa53248570 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:47.646518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2831a4c5-ec28-4c5f-be3d-84fa53248570 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:47.646961 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2831a4c5-ec28-4c5f-be3d-84fa53248570 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:47.647707 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2831a4c5-ec28-4c5f-be3d-84fa53248570 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:47.648154 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2831a4c5-ec28-4c5f-be3d-84fa53248570 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:47.781217 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-2831a4c5-ec28-4c5f-be3d-84fa53248570 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:47.789933 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-2831a4c5-ec28-4c5f-be3d-84fa53248570 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade" status: 200 len: 1366 microversion: 2.1 time: 0.154761 Jul 20 15:40:47.790675 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 469/933] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:40:47 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:40:48.080124 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-4df21f25-4f1a-4438-b294-96d0964d53c3 req-61b08675-af1f-42f1-bebd-dfdc5af003c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34721a3c-bac8-4cea-9f1d-6ee067b62ade", "tag": "23194b35-e97d-47c2-b0aa-7ba393259924"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:40:48.088898 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-4df21f25-4f1a-4438-b294-96d0964d53c3 req-61b08675-af1f-42f1-bebd-dfdc5af003c7 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:48.089344 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-4df21f25-4f1a-4438-b294-96d0964d53c3 req-61b08675-af1f-42f1-bebd-dfdc5af003c7 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:48.101144 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-4df21f25-4f1a-4438-b294-96d0964d53c3 req-61b08675-af1f-42f1-bebd-dfdc5af003c7 service nova] Creating event network-changed:23194b35-e97d-47c2-b0aa-7ba393259924 for instance 34721a3c-bac8-4cea-9f1d-6ee067b62ade on hv-cinder-81914 Jul 20 15:40:48.107001 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-4df21f25-4f1a-4438-b294-96d0964d53c3 req-61b08675-af1f-42f1-bebd-dfdc5af003c7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031806 Jul 20 15:40:48.114020 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 465/934] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:40:48.807487 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-427376f8-40e1-4485-a18e-76eb456c1bb1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:48.808123 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-427376f8-40e1-4485-a18e-76eb456c1bb1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:48.815523 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-427376f8-40e1-4485-a18e-76eb456c1bb1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:48.816012 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-427376f8-40e1-4485-a18e-76eb456c1bb1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:48.816786 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-427376f8-40e1-4485-a18e-76eb456c1bb1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:48.817228 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-427376f8-40e1-4485-a18e-76eb456c1bb1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:48.951478 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-427376f8-40e1-4485-a18e-76eb456c1bb1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:48.959175 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-427376f8-40e1-4485-a18e-76eb456c1bb1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade" status: 200 len: 1366 microversion: 2.1 time: 0.155705 Jul 20 15:40:48.959736 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 470/935] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:40:48 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:40:49.977484 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-01ea2d84-7b82-4f30-9cde-8beb44eb9c15 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:49.978291 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-01ea2d84-7b82-4f30-9cde-8beb44eb9c15 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:49.984916 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-01ea2d84-7b82-4f30-9cde-8beb44eb9c15 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:49.985362 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-01ea2d84-7b82-4f30-9cde-8beb44eb9c15 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:49.986116 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-01ea2d84-7b82-4f30-9cde-8beb44eb9c15 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:49.986583 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-01ea2d84-7b82-4f30-9cde-8beb44eb9c15 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:50.126078 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-01ea2d84-7b82-4f30-9cde-8beb44eb9c15 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:50.133679 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-01ea2d84-7b82-4f30-9cde-8beb44eb9c15 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade" status: 200 len: 1366 microversion: 2.1 time: 0.160887 Jul 20 15:40:50.134250 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 466/936] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:40:49 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:40:51.150712 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-612423f9-98f3-412c-8986-add866a1c8b2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:51.151373 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-612423f9-98f3-412c-8986-add866a1c8b2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:51.158218 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-612423f9-98f3-412c-8986-add866a1c8b2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:51.158653 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-612423f9-98f3-412c-8986-add866a1c8b2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:51.159452 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-612423f9-98f3-412c-8986-add866a1c8b2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:51.159924 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-612423f9-98f3-412c-8986-add866a1c8b2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:51.296089 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-612423f9-98f3-412c-8986-add866a1c8b2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:51.303652 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-612423f9-98f3-412c-8986-add866a1c8b2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade" status: 200 len: 1366 microversion: 2.1 time: 0.157077 Jul 20 15:40:51.304215 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 471/937] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:40:51 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:40:52.320687 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-a21a334e-2431-4f01-8f90-33c0c3c2306c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:52.321362 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-a21a334e-2431-4f01-8f90-33c0c3c2306c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:52.329073 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a21a334e-2431-4f01-8f90-33c0c3c2306c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:52.329073 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a21a334e-2431-4f01-8f90-33c0c3c2306c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:52.329589 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a21a334e-2431-4f01-8f90-33c0c3c2306c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:52.330214 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a21a334e-2431-4f01-8f90-33c0c3c2306c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:52.474864 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-a21a334e-2431-4f01-8f90-33c0c3c2306c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:52.482709 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-a21a334e-2431-4f01-8f90-33c0c3c2306c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade" status: 200 len: 1366 microversion: 2.1 time: 0.165895 Jul 20 15:40:52.483290 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 467/938] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:40:52 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:40:53.513737 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-7b9fb28c-74bb-44d1-b532-da43bf3a50a1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:53.513737 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-7b9fb28c-74bb-44d1-b532-da43bf3a50a1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:53.513737 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=6 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:40:53.513737 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7b9fb28c-74bb-44d1-b532-da43bf3a50a1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:53.513737 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7b9fb28c-74bb-44d1-b532-da43bf3a50a1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:53.514696 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7b9fb28c-74bb-44d1-b532-da43bf3a50a1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:53.514696 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7b9fb28c-74bb-44d1-b532-da43bf3a50a1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:53.662644 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-7b9fb28c-74bb-44d1-b532-da43bf3a50a1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:53.663414 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-7b9fb28c-74bb-44d1-b532-da43bf3a50a1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade" status: 200 len: 1366 microversion: 2.1 time: 0.167486 Jul 20 15:40:53.663633 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 472/939] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:40:53 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:40:54.170236 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-05bca418-802c-4a10-aafa-6de8f106be37 req-77017d6d-7b18-44a5-acb9-41ad38ceb0fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34721a3c-bac8-4cea-9f1d-6ee067b62ade", "name": "network-vif-plugged", "status": "completed", "tag": "23194b35-e97d-47c2-b0aa-7ba393259924"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:40:54.173747 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=2 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:40:54.179817 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-05bca418-802c-4a10-aafa-6de8f106be37 req-77017d6d-7b18-44a5-acb9-41ad38ceb0fd service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:54.180267 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-05bca418-802c-4a10-aafa-6de8f106be37 req-77017d6d-7b18-44a5-acb9-41ad38ceb0fd service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:54.191614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-05bca418-802c-4a10-aafa-6de8f106be37 req-77017d6d-7b18-44a5-acb9-41ad38ceb0fd service nova] Creating event network-vif-plugged:23194b35-e97d-47c2-b0aa-7ba393259924 for instance 34721a3c-bac8-4cea-9f1d-6ee067b62ade on hv-cinder-81914 Jul 20 15:40:54.196846 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-05bca418-802c-4a10-aafa-6de8f106be37 req-77017d6d-7b18-44a5-acb9-41ad38ceb0fd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030379 Jul 20 15:40:54.197487 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 468/940] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:40:54.682442 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-dc2634ae-ebd9-4748-a9ec-5cb16a0576ba tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:54.684251 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-dc2634ae-ebd9-4748-a9ec-5cb16a0576ba tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:54.690657 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dc2634ae-ebd9-4748-a9ec-5cb16a0576ba tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:54.691040 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dc2634ae-ebd9-4748-a9ec-5cb16a0576ba tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:54.691832 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dc2634ae-ebd9-4748-a9ec-5cb16a0576ba tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:54.692304 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dc2634ae-ebd9-4748-a9ec-5cb16a0576ba tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:55.094247 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-dc2634ae-ebd9-4748-a9ec-5cb16a0576ba tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:55.096682 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:40:55.101202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-dc2634ae-ebd9-4748-a9ec-5cb16a0576ba tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade" status: 200 len: 1366 microversion: 2.1 time: 0.424226 Jul 20 15:40:55.101781 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 473/941] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:40:54 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:40:56.115503 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=8 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:40:56.120050 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-26c39672-3b32-42af-8338-0a90ab5e8b91 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:56.120788 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-26c39672-3b32-42af-8338-0a90ab5e8b91 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:56.127806 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-26c39672-3b32-42af-8338-0a90ab5e8b91 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:56.128256 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-26c39672-3b32-42af-8338-0a90ab5e8b91 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:56.129014 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-26c39672-3b32-42af-8338-0a90ab5e8b91 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:56.129450 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-26c39672-3b32-42af-8338-0a90ab5e8b91 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:56.282589 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-26c39672-3b32-42af-8338-0a90ab5e8b91 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:56.289981 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-26c39672-3b32-42af-8338-0a90ab5e8b91 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade" status: 200 len: 1366 microversion: 2.1 time: 0.175454 Jul 20 15:40:56.290569 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 469/942] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:40:56 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:40:57.307760 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-96bd5d2a-a293-415b-95a5-e1d7fa900621 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:57.308371 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-96bd5d2a-a293-415b-95a5-e1d7fa900621 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:57.311179 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:40:57.316258 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-96bd5d2a-a293-415b-95a5-e1d7fa900621 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:57.316702 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-96bd5d2a-a293-415b-95a5-e1d7fa900621 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:57.317464 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-96bd5d2a-a293-415b-95a5-e1d7fa900621 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:57.317899 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-96bd5d2a-a293-415b-95a5-e1d7fa900621 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:57.478685 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-96bd5d2a-a293-415b-95a5-e1d7fa900621 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:40:57.487207 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-96bd5d2a-a293-415b-95a5-e1d7fa900621 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade" status: 200 len: 1556 microversion: 2.1 time: 0.183628 Jul 20 15:40:57.487800 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 474/943] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:40:57 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade => generated 1556 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:40:57.506077 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-3f445991-d0f1-44d6-a487-54c15a1c29db tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:40:57.506598 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-3f445991-d0f1-44d6-a487-54c15a1c29db tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:40:57.508670 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:40:57.513719 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3f445991-d0f1-44d6-a487-54c15a1c29db tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:57.516876 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3f445991-d0f1-44d6-a487-54c15a1c29db tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:57.516876 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3f445991-d0f1-44d6-a487-54c15a1c29db tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:57.516876 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3f445991-d0f1-44d6-a487-54c15a1c29db tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:57.519370 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:40:57.610289 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-3f445991-d0f1-44d6-a487-54c15a1c29db tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109694 Jul 20 15:40:57.610914 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 470/944] 10.222.0.78 () {58 vars in 1274 bytes} [Wed Jul 20 15:40:57 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:40:58.711059 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-86650bd2-07e8-4e0f-972f-6749bc5497c9 req-88f870b9-3ba4-4c39-9b85-57c0994230b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34721a3c-bac8-4cea-9f1d-6ee067b62ade", "tag": "23194b35-e97d-47c2-b0aa-7ba393259924"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:40:58.718019 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-86650bd2-07e8-4e0f-972f-6749bc5497c9 req-88f870b9-3ba4-4c39-9b85-57c0994230b6 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:40:58.718509 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-86650bd2-07e8-4e0f-972f-6749bc5497c9 req-88f870b9-3ba4-4c39-9b85-57c0994230b6 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:40:58.730375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-86650bd2-07e8-4e0f-972f-6749bc5497c9 req-88f870b9-3ba4-4c39-9b85-57c0994230b6 service nova] Creating event network-changed:23194b35-e97d-47c2-b0aa-7ba393259924 for instance 34721a3c-bac8-4cea-9f1d-6ee067b62ade on hv-cinder-81914 Jul 20 15:40:58.736618 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-86650bd2-07e8-4e0f-972f-6749bc5497c9 req-88f870b9-3ba4-4c39-9b85-57c0994230b6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034261 Jul 20 15:40:58.737628 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 475/945] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:41:00.714250 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-95f76ff0-3864-473e-881e-5753ef68e981 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1872893444", "imageRef": "80914b1c-623c-42a8-810e-836b2cce0d3b", "flavorRef": "452", "networks": [{"uuid": "a9891dd5-812a-4da0-b327-b22ce8cc4c25"}]}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:41:00.770392 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.network.neutron [None req-95f76ff0-3864-473e-881e-5753ef68e981 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] validate_networks() for [('a9891dd5-812a-4da0-b327-b22ce8cc4c25', None, None, None, None, None)] {{(pid=124711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 15:41:01.140809 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-95f76ff0-3864-473e-881e-5753ef68e981 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Flavor limits 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 15:41:01.141213 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-95f76ff0-3864-473e-881e-5753ef68e981 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Image limits 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 15:41:01.141732 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-95f76ff0-3864-473e-881e-5753ef68e981 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Flavor pref 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 15:41:01.142179 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-95f76ff0-3864-473e-881e-5753ef68e981 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Image pref 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 15:41:01.142698 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-95f76ff0-3864-473e-881e-5753ef68e981 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 15:41:01.152809 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-95f76ff0-3864-473e-881e-5753ef68e981 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:01.153253 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-95f76ff0-3864-473e-881e-5753ef68e981 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:01.154047 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-95f76ff0-3864-473e-881e-5753ef68e981 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:01.154511 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-95f76ff0-3864-473e-881e-5753ef68e981 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:01.171649 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-95f76ff0-3864-473e-881e-5753ef68e981 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Getting quotas for project 093f88479eae442dba4d8320fbcb2b40. Resources: {'instances', 'ram', 'cores'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:41:01.175828 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-95f76ff0-3864-473e-881e-5753ef68e981 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Getting quotas for user a86c442d85e34a3487c8ad101045ee54 and project 093f88479eae442dba4d8320fbcb2b40. Resources: {'instances', 'ram', 'cores'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:41:01.187716 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-95f76ff0-3864-473e-881e-5753ef68e981 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Going to run 1 instances... {{(pid=124711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 15:41:01.189997 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-95f76ff0-3864-473e-881e-5753ef68e981 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: be425909-522e-43f9-a0d5-305c2409e67b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80914b1c-623c-42a8-810e-836b2cce0d3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 15:41:01.319360 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-95f76ff0-3864-473e-881e-5753ef68e981 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609376 Jul 20 15:41:01.320008 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 471/946] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Jul 20 15:41:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 15:41:01.331419 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-c52a48e7-07d6-4e88-a09a-08267b315aa9 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:01.332191 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-c52a48e7-07d6-4e88-a09a-08267b315aa9 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: be425909-522e-43f9-a0d5-305c2409e67b] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:01.392172 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-c52a48e7-07d6-4e88-a09a-08267b315aa9 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:01.398815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-c52a48e7-07d6-4e88-a09a-08267b315aa9 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b" status: 200 len: 1214 microversion: 2.1 time: 0.072488 Jul 20 15:41:01.399653 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 476/947] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:01 2022] GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:02.416909 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d0d8939c-fd1c-49b2-875d-39f5684aaaa3 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:02.417801 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-d0d8939c-fd1c-49b2-875d-39f5684aaaa3 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: be425909-522e-43f9-a0d5-305c2409e67b] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:02.426605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d0d8939c-fd1c-49b2-875d-39f5684aaaa3 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:02.427185 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d0d8939c-fd1c-49b2-875d-39f5684aaaa3 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:02.427963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d0d8939c-fd1c-49b2-875d-39f5684aaaa3 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:02.428406 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d0d8939c-fd1c-49b2-875d-39f5684aaaa3 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:02.491964 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d0d8939c-fd1c-49b2-875d-39f5684aaaa3 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:02.500858 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d0d8939c-fd1c-49b2-875d-39f5684aaaa3 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b" status: 200 len: 1218 microversion: 2.1 time: 0.088501 Jul 20 15:41:02.505049 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 472/948] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:02 2022] GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:03.517242 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b6a7729c-9967-4e8b-ae5c-32406ebb9d14 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:03.522639 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b6a7729c-9967-4e8b-ae5c-32406ebb9d14 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: be425909-522e-43f9-a0d5-305c2409e67b] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:03.525550 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b6a7729c-9967-4e8b-ae5c-32406ebb9d14 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:03.526006 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b6a7729c-9967-4e8b-ae5c-32406ebb9d14 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:03.526801 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b6a7729c-9967-4e8b-ae5c-32406ebb9d14 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:03.527239 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b6a7729c-9967-4e8b-ae5c-32406ebb9d14 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:03.593017 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b6a7729c-9967-4e8b-ae5c-32406ebb9d14 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:03.601325 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b6a7729c-9967-4e8b-ae5c-32406ebb9d14 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b" status: 200 len: 1274 microversion: 2.1 time: 0.088076 Jul 20 15:41:03.602184 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 477/949] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:03 2022] GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:04.618992 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-63f0134d-ee02-4afa-9211-e31baace9d5b tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:04.619638 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-63f0134d-ee02-4afa-9211-e31baace9d5b tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: be425909-522e-43f9-a0d5-305c2409e67b] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:04.626976 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-63f0134d-ee02-4afa-9211-e31baace9d5b tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:04.627421 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-63f0134d-ee02-4afa-9211-e31baace9d5b tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:04.628339 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-63f0134d-ee02-4afa-9211-e31baace9d5b tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:04.628778 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-63f0134d-ee02-4afa-9211-e31baace9d5b tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:04.765893 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-63f0134d-ee02-4afa-9211-e31baace9d5b tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:04.773659 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-63f0134d-ee02-4afa-9211-e31baace9d5b tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b" status: 200 len: 1314 microversion: 2.1 time: 0.158647 Jul 20 15:41:04.774219 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 473/950] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:04 2022] GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:05.692579 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-139615bd-3208-490b-8047-4eb0fde97cc3 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:05.693738 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-139615bd-3208-490b-8047-4eb0fde97cc3 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:05.699643 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-770ed8ea-cdcb-480d-b88f-959ff890b4a5 req-9d3303ff-642e-4161-9390-923bb1f1f282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "562e58cb-a1c0-4582-b4aa-46abf6053c11", "tag": "5dcfcdca-0e07-4def-8734-604f0229a302"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:41:05.704075 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-139615bd-3208-490b-8047-4eb0fde97cc3 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:05.704075 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-139615bd-3208-490b-8047-4eb0fde97cc3 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:05.704075 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-139615bd-3208-490b-8047-4eb0fde97cc3 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:05.704860 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-139615bd-3208-490b-8047-4eb0fde97cc3 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:05.711209 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-770ed8ea-cdcb-480d-b88f-959ff890b4a5 req-9d3303ff-642e-4161-9390-923bb1f1f282 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:05.711941 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-770ed8ea-cdcb-480d-b88f-959ff890b4a5 req-9d3303ff-642e-4161-9390-923bb1f1f282 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:05.726065 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-770ed8ea-cdcb-480d-b88f-959ff890b4a5 req-9d3303ff-642e-4161-9390-923bb1f1f282 service nova] Creating event network-changed:5dcfcdca-0e07-4def-8734-604f0229a302 for instance 562e58cb-a1c0-4582-b4aa-46abf6053c11 on hv-cinder-81914 Jul 20 15:41:05.731199 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-770ed8ea-cdcb-480d-b88f-959ff890b4a5 req-9d3303ff-642e-4161-9390-923bb1f1f282 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036440 Jul 20 15:41:05.732683 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 474/951] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:41:05.740154 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-139615bd-3208-490b-8047-4eb0fde97cc3 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Going to try to terminate instance {{(pid=124712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 15:41:05.798332 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-0d7fde57-aecd-4ac2-91a2-67b53fb47622 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:05.799409 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-0d7fde57-aecd-4ac2-91a2-67b53fb47622 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: be425909-522e-43f9-a0d5-305c2409e67b] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:05.806730 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0d7fde57-aecd-4ac2-91a2-67b53fb47622 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:05.807463 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0d7fde57-aecd-4ac2-91a2-67b53fb47622 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:05.808428 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0d7fde57-aecd-4ac2-91a2-67b53fb47622 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:05.809160 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0d7fde57-aecd-4ac2-91a2-67b53fb47622 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:06.079157 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-139615bd-3208-490b-8047-4eb0fde97cc3 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "DELETE /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 204 len: 0 microversion: 2.1 time: 0.390364 Jul 20 15:41:06.079952 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 478/952] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:41:05 2022] DELETE /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 15:41:06.088774 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-50223b15-7ded-487c-9c2a-9c14e214d70d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:06.089769 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-50223b15-7ded-487c-9c2a-9c14e214d70d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:06.096650 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-50223b15-7ded-487c-9c2a-9c14e214d70d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:06.097299 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-50223b15-7ded-487c-9c2a-9c14e214d70d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:06.097959 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-50223b15-7ded-487c-9c2a-9c14e214d70d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:06.098426 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-50223b15-7ded-487c-9c2a-9c14e214d70d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:06.113163 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-0d7fde57-aecd-4ac2-91a2-67b53fb47622 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:06.122891 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-0d7fde57-aecd-4ac2-91a2-67b53fb47622 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b" status: 200 len: 1314 microversion: 2.1 time: 0.330149 Jul 20 15:41:06.123671 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 475/953] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:05 2022] GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:06.236500 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-50223b15-7ded-487c-9c2a-9c14e214d70d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:06.244287 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-50223b15-7ded-487c-9c2a-9c14e214d70d tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1567 microversion: 2.1 time: 0.160030 Jul 20 15:41:06.244960 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 479/954] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:06 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:07.140070 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-00243743-c973-412f-9d20-37d8dcbf748e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:07.140673 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-00243743-c973-412f-9d20-37d8dcbf748e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: be425909-522e-43f9-a0d5-305c2409e67b] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:07.147085 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-00243743-c973-412f-9d20-37d8dcbf748e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:07.147524 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-00243743-c973-412f-9d20-37d8dcbf748e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:07.148268 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-00243743-c973-412f-9d20-37d8dcbf748e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:07.148693 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-00243743-c973-412f-9d20-37d8dcbf748e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:07.264431 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d65d9391-7bfc-4c3e-8a98-b1b034eec845 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:07.265282 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d65d9391-7bfc-4c3e-8a98-b1b034eec845 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:07.272042 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d65d9391-7bfc-4c3e-8a98-b1b034eec845 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:07.272582 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d65d9391-7bfc-4c3e-8a98-b1b034eec845 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:07.273425 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d65d9391-7bfc-4c3e-8a98-b1b034eec845 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:07.273927 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d65d9391-7bfc-4c3e-8a98-b1b034eec845 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:07.355144 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-00243743-c973-412f-9d20-37d8dcbf748e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:07.363020 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-00243743-c973-412f-9d20-37d8dcbf748e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b" status: 200 len: 1314 microversion: 2.1 time: 0.227257 Jul 20 15:41:07.363597 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 476/955] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:07 2022] GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:07.508331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d65d9391-7bfc-4c3e-8a98-b1b034eec845 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:07.519219 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-d65d9391-7bfc-4c3e-8a98-b1b034eec845 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1567 microversion: 2.1 time: 0.259290 Jul 20 15:41:07.520125 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 480/956] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:07 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1567 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:41:07.752589 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-4961ab10-e86d-4fde-8cab-ed0b95e23343 req-0b406260-b097-4a79-9a67-f316da0b0525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be425909-522e-43f9-a0d5-305c2409e67b", "tag": "c710f5a7-59a7-4df8-8db3-03cadaa0c678"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:41:07.761448 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-4961ab10-e86d-4fde-8cab-ed0b95e23343 req-0b406260-b097-4a79-9a67-f316da0b0525 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:07.762235 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-4961ab10-e86d-4fde-8cab-ed0b95e23343 req-0b406260-b097-4a79-9a67-f316da0b0525 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:07.776968 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-4961ab10-e86d-4fde-8cab-ed0b95e23343 req-0b406260-b097-4a79-9a67-f316da0b0525 service nova] Creating event network-changed:c710f5a7-59a7-4df8-8db3-03cadaa0c678 for instance be425909-522e-43f9-a0d5-305c2409e67b on hv-cinder-81914 Jul 20 15:41:07.783295 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-4961ab10-e86d-4fde-8cab-ed0b95e23343 req-0b406260-b097-4a79-9a67-f316da0b0525 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035345 Jul 20 15:41:07.784971 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 477/957] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:41:08.379394 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e8c48d68-3239-43d5-a768-c562130ed5b4 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:08.380005 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e8c48d68-3239-43d5-a768-c562130ed5b4 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: be425909-522e-43f9-a0d5-305c2409e67b] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:08.391082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e8c48d68-3239-43d5-a768-c562130ed5b4 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:08.391541 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e8c48d68-3239-43d5-a768-c562130ed5b4 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:08.392511 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e8c48d68-3239-43d5-a768-c562130ed5b4 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:08.392950 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e8c48d68-3239-43d5-a768-c562130ed5b4 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:08.528112 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-e8c48d68-3239-43d5-a768-c562130ed5b4 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:08.535925 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-e8c48d68-3239-43d5-a768-c562130ed5b4 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b" status: 200 len: 1314 microversion: 2.1 time: 0.160467 Jul 20 15:41:08.536495 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 481/958] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:08 2022] GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:08.538657 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-62515e19-fed9-42e8-b5bc-9abdab7ef934 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:08.539309 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-62515e19-fed9-42e8-b5bc-9abdab7ef934 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:08.545834 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-62515e19-fed9-42e8-b5bc-9abdab7ef934 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:08.546303 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-62515e19-fed9-42e8-b5bc-9abdab7ef934 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:08.547163 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-62515e19-fed9-42e8-b5bc-9abdab7ef934 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:08.548281 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-62515e19-fed9-42e8-b5bc-9abdab7ef934 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:08.616767 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-62515e19-fed9-42e8-b5bc-9abdab7ef934 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:08.627473 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-62515e19-fed9-42e8-b5bc-9abdab7ef934 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1381 microversion: 2.1 time: 0.094270 Jul 20 15:41:08.628057 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 478/959] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:08 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1381 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:09.552922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-cb2b1d23-f6b5-4d30-a677-1b9d29edf2d1 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:09.553528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-cb2b1d23-f6b5-4d30-a677-1b9d29edf2d1 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: be425909-522e-43f9-a0d5-305c2409e67b] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:09.560273 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cb2b1d23-f6b5-4d30-a677-1b9d29edf2d1 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:09.560710 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cb2b1d23-f6b5-4d30-a677-1b9d29edf2d1 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:09.561465 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cb2b1d23-f6b5-4d30-a677-1b9d29edf2d1 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:09.561893 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-cb2b1d23-f6b5-4d30-a677-1b9d29edf2d1 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:09.648922 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-950e0726-9e36-4c9e-82c4-057d22c6ee0b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:09.649528 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-950e0726-9e36-4c9e-82c4-057d22c6ee0b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:09.657685 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-950e0726-9e36-4c9e-82c4-057d22c6ee0b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:09.658130 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-950e0726-9e36-4c9e-82c4-057d22c6ee0b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:09.658935 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-950e0726-9e36-4c9e-82c4-057d22c6ee0b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:09.659364 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-950e0726-9e36-4c9e-82c4-057d22c6ee0b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:09.697137 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-cb2b1d23-f6b5-4d30-a677-1b9d29edf2d1 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:09.705453 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-cb2b1d23-f6b5-4d30-a677-1b9d29edf2d1 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b" status: 200 len: 1314 microversion: 2.1 time: 0.156387 Jul 20 15:41:09.706031 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 482/960] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:09 2022] GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:09.727826 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-950e0726-9e36-4c9e-82c4-057d22c6ee0b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec2e023235a343dd81754211ee102f3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09d92d320f8748c58aca3fd6a8776540', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:09.735232 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-950e0726-9e36-4c9e-82c4-057d22c6ee0b tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 200 len: 1218 microversion: 2.1 time: 0.090195 Jul 20 15:41:09.735787 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 479/961] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:09 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:09.798131 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-d974250a-1e62-46fe-bcfa-5544569b9755 req-f72699e0-fa3a-4e63-981b-375c3f08e678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "562e58cb-a1c0-4582-b4aa-46abf6053c11", "name": "network-vif-deleted", "tag": "5dcfcdca-0e07-4def-8734-604f0229a302"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:41:09.806541 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-d974250a-1e62-46fe-bcfa-5544569b9755 req-f72699e0-fa3a-4e63-981b-375c3f08e678 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:09.806983 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-d974250a-1e62-46fe-bcfa-5544569b9755 req-f72699e0-fa3a-4e63-981b-375c3f08e678 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:09.818322 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-d974250a-1e62-46fe-bcfa-5544569b9755 req-f72699e0-fa3a-4e63-981b-375c3f08e678 service nova] Creating event network-vif-deleted:5dcfcdca-0e07-4def-8734-604f0229a302 for instance 562e58cb-a1c0-4582-b4aa-46abf6053c11 on hv-cinder-81914 Jul 20 15:41:09.822926 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-d974250a-1e62-46fe-bcfa-5544569b9755 req-f72699e0-fa3a-4e63-981b-375c3f08e678 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029042 Jul 20 15:41:09.823551 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 483/962] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:41:10.722594 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c3bd5bff-b105-44aa-8a95-f3116e137650 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:10.723152 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c3bd5bff-b105-44aa-8a95-f3116e137650 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: be425909-522e-43f9-a0d5-305c2409e67b] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:10.730384 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c3bd5bff-b105-44aa-8a95-f3116e137650 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:10.730832 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c3bd5bff-b105-44aa-8a95-f3116e137650 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:10.731614 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c3bd5bff-b105-44aa-8a95-f3116e137650 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:10.732068 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c3bd5bff-b105-44aa-8a95-f3116e137650 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:10.753143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-0fe2511d-2739-4df3-b11a-8600ed96ccbe tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:10.754037 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-0fe2511d-2739-4df3-b11a-8600ed96ccbe tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] [instance: 562e58cb-a1c0-4582-b4aa-46abf6053c11] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:10.760374 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0fe2511d-2739-4df3-b11a-8600ed96ccbe tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:10.760822 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0fe2511d-2739-4df3-b11a-8600ed96ccbe tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:10.761584 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0fe2511d-2739-4df3-b11a-8600ed96ccbe tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:10.762017 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0fe2511d-2739-4df3-b11a-8600ed96ccbe tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:10.782841 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-0fe2511d-2739-4df3-b11a-8600ed96ccbe tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] HTTP exception thrown: Instance 562e58cb-a1c0-4582-b4aa-46abf6053c11 could not be found. Jul 20 15:41:10.784506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-0fe2511d-2739-4df3-b11a-8600ed96ccbe tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Request method failure captured: Jul 20 15:41:10.784506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 HTTP/1.1 Jul 20 15:41:10.784506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:41:10.784506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:41:10.784506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:41:10.784506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:41:10.784506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:41:10.784506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:41:10.784506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:41:10.784506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:41:10.784506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2CDDqhdRfNPFq1x3VGb5NuiXq4d-FaDS-O4tDFjXZHZmAYxwa4YdK4LN5ZKyWpMLsQBuEeQea-FUdyk85yg4-RY9JX-FiDc2IP0JooTYzuZxPXhtaeViQfkCQEAP_wmkptgKwnXwS2voFwXxoLAwB9LHQlm3XM--5XhlOrue38dgBmE Jul 20 15:41:10.784506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:41:10.784506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:41:10.784506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:41:10.784506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:41:10.784506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:41:10.784506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:41:10.784506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 09d92d320f8748c58aca3fd6a8776540 Jul 20 15:41:10.784506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-TestShelveInstance-638114294 Jul 20 15:41:10.784506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:41:10.784506 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:41:10.786061 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09d92d320f8748c58aca3fd6a8776540"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/09d92d320f8748c58aca3fd6a8776540"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_09d92d320f8748c58aca3fd6a8776540", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/09d92d320f8748c58aca3fd6a8776540"}]}] Jul 20 15:41:10.786061 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-TestShelveInstance-638114294 Jul 20 15:41:10.786061 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 09d92d320f8748c58aca3fd6a8776540 Jul 20 15:41:10.786061 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-TestShelveInstance-638114294 Jul 20 15:41:10.786061 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-TestShelveInstance-638114294-project Jul 20 15:41:10.786061 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:41:10.786061 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:41:10.786061 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: ec2e023235a343dd81754211ee102f3c Jul 20 15:41:10.786061 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-TestShelveInstance-638114294-project Jul 20 15:41:10.786061 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:41:10.786061 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance 562e58cb-a1c0-4582-b4aa-46abf6053c11 could not be found. Jul 20 15:41:10.786061 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': '562e58cb-a1c0-4582-b4aa-46abf6053c11'} Jul 20 15:41:10.787010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:41:10.787010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:41:10.787010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:41:10.787010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:41:10.787010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:41:10.787010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:41:10.787010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:41:10.787010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:41:10.787010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:41:10.787010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:41:10.787010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 562e58cb-a1c0-4582-b4aa-46abf6053c11 could not be found. Jul 20 15:41:10.787010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:41:10.787010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:41:10.787010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:41:10.787010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:41:10.787010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:41:10.787010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:41:10.787010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:41:10.787010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:41:10.787010 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:41:10.788594 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:41:10.788594 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:41:10.788594 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:41:10.788594 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:41:10.788594 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:41:10.788594 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:41:10.788594 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:41:10.788594 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 562e58cb-a1c0-4582-b4aa-46abf6053c11 could not be found. Jul 20 15:41:10.788594 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:41:10.788594 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:41:10.788594 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:41:10.788594 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:41:10.788594 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:41:10.788594 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:41:10.788594 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:41:10.788594 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:41:10.788594 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 562e58cb-a1c0-4582-b4aa-46abf6053c11 could not be found. Jul 20 15:41:10.788594 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:41:10.790132 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-0fe2511d-2739-4df3-b11a-8600ed96ccbe tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Returning 404 to user: Instance 562e58cb-a1c0-4582-b4aa-46abf6053c11 could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:41:10.790132 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-0fe2511d-2739-4df3-b11a-8600ed96ccbe tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11" status: 404 len: 111 microversion: 2.1 time: 0.037461 Jul 20 15:41:10.790132 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 484/963] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:10 2022] GET /compute/v2.1/servers/562e58cb-a1c0-4582-b4aa-46abf6053c11 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 15:41:10.869735 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c3bd5bff-b105-44aa-8a95-f3116e137650 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:10.877876 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c3bd5bff-b105-44aa-8a95-f3116e137650 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b" status: 200 len: 1314 microversion: 2.1 time: 0.159239 Jul 20 15:41:10.878580 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 480/964] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:10 2022] GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:11.059835 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-3d362319-a83e-4c52-b3d6-0231cad98562 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] Calling method '.version_select at 0x7efd90a36280>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:11.141792 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-3d362319-a83e-4c52-b3d6-0231cad98562 tempest-TestShelveInstance-638114294 tempest-TestShelveInstance-638114294-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-419272811" status: 202 len: 0 microversion: 2.1 time: 0.086697 Jul 20 15:41:11.142435 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 485/965] 10.222.0.78 () {58 vars in 1250 bytes} [Wed Jul 20 15:41:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-419272811 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:41:11.894780 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-8cf10d8b-880f-4a71-9628-6a6c7e756e6d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:11.895387 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-8cf10d8b-880f-4a71-9628-6a6c7e756e6d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: be425909-522e-43f9-a0d5-305c2409e67b] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:11.905979 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=2 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:11.905979 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=6 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:11.905979 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8cf10d8b-880f-4a71-9628-6a6c7e756e6d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:11.905979 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8cf10d8b-880f-4a71-9628-6a6c7e756e6d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:11.905979 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8cf10d8b-880f-4a71-9628-6a6c7e756e6d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:11.906517 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8cf10d8b-880f-4a71-9628-6a6c7e756e6d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:12.043211 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-8cf10d8b-880f-4a71-9628-6a6c7e756e6d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:12.051013 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-8cf10d8b-880f-4a71-9628-6a6c7e756e6d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b" status: 200 len: 1314 microversion: 2.1 time: 0.160156 Jul 20 15:41:12.051583 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 481/966] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:11 2022] GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:13.068970 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-9428bf49-219e-4557-a4b7-fe3f70c6098e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:13.069606 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-9428bf49-219e-4557-a4b7-fe3f70c6098e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: be425909-522e-43f9-a0d5-305c2409e67b] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:13.073090 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=2 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:13.079099 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9428bf49-219e-4557-a4b7-fe3f70c6098e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:13.088591 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9428bf49-219e-4557-a4b7-fe3f70c6098e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:13.088591 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9428bf49-219e-4557-a4b7-fe3f70c6098e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:13.088591 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9428bf49-219e-4557-a4b7-fe3f70c6098e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:13.274532 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-9428bf49-219e-4557-a4b7-fe3f70c6098e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:13.287143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-9428bf49-219e-4557-a4b7-fe3f70c6098e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b" status: 200 len: 1314 microversion: 2.1 time: 0.221906 Jul 20 15:41:13.287944 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 486/967] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:13 2022] GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:14.239377 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-b1431512-8307-4e95-8dd5-c50a25e7276a req-3bef1dd5-3d70-4e57-b374-a8dd919dd14c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be425909-522e-43f9-a0d5-305c2409e67b", "name": "network-vif-plugged", "status": "completed", "tag": "c710f5a7-59a7-4df8-8db3-03cadaa0c678"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:41:14.249657 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-b1431512-8307-4e95-8dd5-c50a25e7276a req-3bef1dd5-3d70-4e57-b374-a8dd919dd14c service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:14.250100 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-b1431512-8307-4e95-8dd5-c50a25e7276a req-3bef1dd5-3d70-4e57-b374-a8dd919dd14c service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:14.266393 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-b1431512-8307-4e95-8dd5-c50a25e7276a req-3bef1dd5-3d70-4e57-b374-a8dd919dd14c service nova] Creating event network-vif-plugged:c710f5a7-59a7-4df8-8db3-03cadaa0c678 for instance be425909-522e-43f9-a0d5-305c2409e67b on hv-cinder-81914 Jul 20 15:41:14.268187 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-b1431512-8307-4e95-8dd5-c50a25e7276a req-3bef1dd5-3d70-4e57-b374-a8dd919dd14c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032851 Jul 20 15:41:14.269089 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 482/968] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:41:14.305934 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-565fd786-83ff-4fbf-8c97-71a233ad7e3e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:14.306683 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-565fd786-83ff-4fbf-8c97-71a233ad7e3e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: be425909-522e-43f9-a0d5-305c2409e67b] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:14.317740 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-565fd786-83ff-4fbf-8c97-71a233ad7e3e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:14.317740 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-565fd786-83ff-4fbf-8c97-71a233ad7e3e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:14.317740 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-565fd786-83ff-4fbf-8c97-71a233ad7e3e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:14.317740 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-565fd786-83ff-4fbf-8c97-71a233ad7e3e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:14.534096 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-565fd786-83ff-4fbf-8c97-71a233ad7e3e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:14.542244 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-565fd786-83ff-4fbf-8c97-71a233ad7e3e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b" status: 200 len: 1314 microversion: 2.1 time: 0.240657 Jul 20 15:41:14.542846 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 487/969] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:14 2022] GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:15.562526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-937de4e9-e9a6-4aab-af16-bf1e667c7336 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:15.563267 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-937de4e9-e9a6-4aab-af16-bf1e667c7336 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: be425909-522e-43f9-a0d5-305c2409e67b] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:15.571012 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-937de4e9-e9a6-4aab-af16-bf1e667c7336 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:15.571741 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-937de4e9-e9a6-4aab-af16-bf1e667c7336 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:15.573008 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-937de4e9-e9a6-4aab-af16-bf1e667c7336 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:15.573731 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-937de4e9-e9a6-4aab-af16-bf1e667c7336 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:15.727868 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-937de4e9-e9a6-4aab-af16-bf1e667c7336 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:15.735547 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-937de4e9-e9a6-4aab-af16-bf1e667c7336 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b" status: 200 len: 1314 microversion: 2.1 time: 0.178839 Jul 20 15:41:15.736123 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 483/970] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:15 2022] GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:16.752877 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-a753d0db-4c02-4087-af20-2be569be7c4d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:16.753486 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-a753d0db-4c02-4087-af20-2be569be7c4d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: be425909-522e-43f9-a0d5-305c2409e67b] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:16.759954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a753d0db-4c02-4087-af20-2be569be7c4d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:16.760407 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a753d0db-4c02-4087-af20-2be569be7c4d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:16.767104 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a753d0db-4c02-4087-af20-2be569be7c4d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:16.767104 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a753d0db-4c02-4087-af20-2be569be7c4d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:16.910730 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-a753d0db-4c02-4087-af20-2be569be7c4d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:16.919141 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-a753d0db-4c02-4087-af20-2be569be7c4d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b" status: 200 len: 1497 microversion: 2.1 time: 0.169580 Jul 20 15:41:16.919710 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 488/971] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:16 2022] GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:18.118444 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-f914a164-04d3-4615-b50a-2ce9b47cbb46 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:18.119234 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-f914a164-04d3-4615-b50a-2ce9b47cbb46 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: be425909-522e-43f9-a0d5-305c2409e67b] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:18.125927 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f914a164-04d3-4615-b50a-2ce9b47cbb46 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:18.126400 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f914a164-04d3-4615-b50a-2ce9b47cbb46 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:18.127173 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f914a164-04d3-4615-b50a-2ce9b47cbb46 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:18.127606 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f914a164-04d3-4615-b50a-2ce9b47cbb46 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:18.153229 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-f914a164-04d3-4615-b50a-2ce9b47cbb46 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: be425909-522e-43f9-a0d5-305c2409e67b] Going to try to terminate instance {{(pid=124711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 15:41:18.614253 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-f914a164-04d3-4615-b50a-2ce9b47cbb46 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "DELETE /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b" status: 204 len: 0 microversion: 2.1 time: 0.502411 Jul 20 15:41:18.615118 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 484/972] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:41:18 2022] DELETE /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 15:41:18.622981 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-345e2e68-0f49-48a9-a193-c72cd096bdd6 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:18.623593 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-345e2e68-0f49-48a9-a193-c72cd096bdd6 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: be425909-522e-43f9-a0d5-305c2409e67b] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:18.630672 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-345e2e68-0f49-48a9-a193-c72cd096bdd6 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:18.633665 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-345e2e68-0f49-48a9-a193-c72cd096bdd6 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:18.633665 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-345e2e68-0f49-48a9-a193-c72cd096bdd6 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:18.633665 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-345e2e68-0f49-48a9-a193-c72cd096bdd6 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:18.804813 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-345e2e68-0f49-48a9-a193-c72cd096bdd6 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:18.813487 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-345e2e68-0f49-48a9-a193-c72cd096bdd6 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b" status: 200 len: 1503 microversion: 2.1 time: 0.194280 Jul 20 15:41:18.814066 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 489/973] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:18 2022] GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:19.831279 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5e97d268-7923-4b30-b9a7-fb5008a0e112 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:19.831976 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5e97d268-7923-4b30-b9a7-fb5008a0e112 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: be425909-522e-43f9-a0d5-305c2409e67b] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:19.838573 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e97d268-7923-4b30-b9a7-fb5008a0e112 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:19.839023 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e97d268-7923-4b30-b9a7-fb5008a0e112 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:19.839782 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e97d268-7923-4b30-b9a7-fb5008a0e112 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:19.840709 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e97d268-7923-4b30-b9a7-fb5008a0e112 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:20.033945 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5e97d268-7923-4b30-b9a7-fb5008a0e112 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:20.042540 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5e97d268-7923-4b30-b9a7-fb5008a0e112 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b" status: 200 len: 1503 microversion: 2.1 time: 0.215071 Jul 20 15:41:20.043775 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 485/974] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:19 2022] GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b => generated 1503 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:41:20.704107 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-da7360a9-0add-4190-9c1b-d2b13f9d8e34 req-68c0d875-8c40-45f3-a8c4-98e0ed1dbc1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be425909-522e-43f9-a0d5-305c2409e67b", "name": "network-vif-deleted", "tag": "c710f5a7-59a7-4df8-8db3-03cadaa0c678"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:41:20.712733 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-da7360a9-0add-4190-9c1b-d2b13f9d8e34 req-68c0d875-8c40-45f3-a8c4-98e0ed1dbc1d service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:20.713179 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-da7360a9-0add-4190-9c1b-d2b13f9d8e34 req-68c0d875-8c40-45f3-a8c4-98e0ed1dbc1d service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:20.724156 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-da7360a9-0add-4190-9c1b-d2b13f9d8e34 req-68c0d875-8c40-45f3-a8c4-98e0ed1dbc1d service nova] Creating event network-vif-deleted:c710f5a7-59a7-4df8-8db3-03cadaa0c678 for instance be425909-522e-43f9-a0d5-305c2409e67b on hv-cinder-81914 Jul 20 15:41:20.729227 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-da7360a9-0add-4190-9c1b-d2b13f9d8e34 req-68c0d875-8c40-45f3-a8c4-98e0ed1dbc1d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029118 Jul 20 15:41:20.729827 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 490/975] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:41:21.060779 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-16fa41d8-b00f-40d0-aafd-828d4835eb46 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:21.061385 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-16fa41d8-b00f-40d0-aafd-828d4835eb46 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: be425909-522e-43f9-a0d5-305c2409e67b] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:21.067744 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-16fa41d8-b00f-40d0-aafd-828d4835eb46 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:21.068188 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-16fa41d8-b00f-40d0-aafd-828d4835eb46 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:21.068943 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-16fa41d8-b00f-40d0-aafd-828d4835eb46 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:21.069374 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-16fa41d8-b00f-40d0-aafd-828d4835eb46 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:21.146411 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-16fa41d8-b00f-40d0-aafd-828d4835eb46 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:21.152373 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-16fa41d8-b00f-40d0-aafd-828d4835eb46 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b" status: 200 len: 1299 microversion: 2.1 time: 0.095987 Jul 20 15:41:21.152931 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 486/976] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:21 2022] GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:22.169990 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-a61acb1d-b015-4d3e-b10b-3430cb15079d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:22.170721 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-a61acb1d-b015-4d3e-b10b-3430cb15079d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: be425909-522e-43f9-a0d5-305c2409e67b] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:22.177136 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a61acb1d-b015-4d3e-b10b-3430cb15079d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:22.177587 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a61acb1d-b015-4d3e-b10b-3430cb15079d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:22.178381 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a61acb1d-b015-4d3e-b10b-3430cb15079d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:22.178823 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a61acb1d-b015-4d3e-b10b-3430cb15079d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:22.192226 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-a61acb1d-b015-4d3e-b10b-3430cb15079d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] HTTP exception thrown: Instance be425909-522e-43f9-a0d5-305c2409e67b could not be found. Jul 20 15:41:22.193861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-a61acb1d-b015-4d3e-b10b-3430cb15079d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Request method failure captured: Jul 20 15:41:22.193861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b HTTP/1.1 Jul 20 15:41:22.193861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:41:22.193861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:41:22.193861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:41:22.193861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:41:22.193861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:41:22.193861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:41:22.193861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:41:22.193861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:41:22.193861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2CIKWhL3oKkuHP0J69ZhEq90KYrMw3l0L8kKqSRhknQt5tEoi44y_tuMJUfHqsjCTaVYRstp1r_T5n6yn2_a_QdAcIHBltFBOnLaDSUbV_Hb3BvK6dNZF0oIH8BBufsR91u8HV6vfYZKNX4ipiER9GQ15sVIC_cE7KJuw8VXzvRSGYQ Jul 20 15:41:22.193861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:41:22.193861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:41:22.193861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:41:22.193861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:41:22.193861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:41:22.193861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:41:22.193861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 093f88479eae442dba4d8320fbcb2b40 Jul 20 15:41:22.193861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-VolumesActionsTest-1826082824 Jul 20 15:41:22.193861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:41:22.193861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:41:22.195532 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/093f88479eae442dba4d8320fbcb2b40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/093f88479eae442dba4d8320fbcb2b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_093f88479eae442dba4d8320fbcb2b40", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/093f88479eae442dba4d8320fbcb2b40"}]}] Jul 20 15:41:22.195532 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-VolumesActionsTest-1826082824 Jul 20 15:41:22.195532 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 093f88479eae442dba4d8320fbcb2b40 Jul 20 15:41:22.195532 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-VolumesActionsTest-1826082824 Jul 20 15:41:22.195532 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-VolumesActionsTest-1826082824-project Jul 20 15:41:22.195532 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:41:22.195532 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:41:22.195532 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: a86c442d85e34a3487c8ad101045ee54 Jul 20 15:41:22.195532 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-VolumesActionsTest-1826082824-project Jul 20 15:41:22.195532 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:41:22.195532 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance be425909-522e-43f9-a0d5-305c2409e67b could not be found. Jul 20 15:41:22.195532 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': 'be425909-522e-43f9-a0d5-305c2409e67b'} Jul 20 15:41:22.196504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:41:22.196504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:41:22.196504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:41:22.196504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:41:22.196504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:41:22.196504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:41:22.196504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:41:22.196504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:41:22.196504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:41:22.196504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:41:22.196504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be425909-522e-43f9-a0d5-305c2409e67b could not be found. Jul 20 15:41:22.196504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:41:22.196504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:41:22.196504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:41:22.196504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:41:22.196504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:41:22.196504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:41:22.196504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:41:22.196504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:41:22.196504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:41:22.198026 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:41:22.198026 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:41:22.198026 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:41:22.198026 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:41:22.198026 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:41:22.198026 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:41:22.198026 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:41:22.198026 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be425909-522e-43f9-a0d5-305c2409e67b could not be found. Jul 20 15:41:22.198026 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:41:22.198026 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:41:22.198026 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:41:22.198026 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:41:22.198026 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:41:22.198026 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:41:22.198026 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:41:22.198026 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:41:22.198026 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be425909-522e-43f9-a0d5-305c2409e67b could not be found. Jul 20 15:41:22.198026 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:41:22.199958 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-a61acb1d-b015-4d3e-b10b-3430cb15079d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Returning 404 to user: Instance be425909-522e-43f9-a0d5-305c2409e67b could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:41:22.199958 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-a61acb1d-b015-4d3e-b10b-3430cb15079d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b" status: 404 len: 111 microversion: 2.1 time: 0.030042 Jul 20 15:41:22.199958 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 491/977] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:22 2022] GET /compute/v2.1/servers/be425909-522e-43f9-a0d5-305c2409e67b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:41:22.352014 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-bea3ae93-e030-46b7-8da5-67a758cf5be0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1857184511", "imageRef": "80914b1c-623c-42a8-810e-836b2cce0d3b", "flavorRef": "452", "networks": [{"uuid": "a9891dd5-812a-4da0-b327-b22ce8cc4c25"}]}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:41:22.403977 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.network.neutron [None req-bea3ae93-e030-46b7-8da5-67a758cf5be0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] validate_networks() for [('a9891dd5-812a-4da0-b327-b22ce8cc4c25', None, None, None, None, None)] {{(pid=124711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 15:41:23.006350 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-bea3ae93-e030-46b7-8da5-67a758cf5be0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Flavor limits 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 15:41:23.006862 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-bea3ae93-e030-46b7-8da5-67a758cf5be0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Image limits 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 15:41:23.007372 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-bea3ae93-e030-46b7-8da5-67a758cf5be0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Flavor pref 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 15:41:23.007793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-bea3ae93-e030-46b7-8da5-67a758cf5be0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Image pref 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 15:41:23.008211 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-bea3ae93-e030-46b7-8da5-67a758cf5be0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 15:41:23.017009 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bea3ae93-e030-46b7-8da5-67a758cf5be0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:23.017445 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bea3ae93-e030-46b7-8da5-67a758cf5be0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:23.018229 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bea3ae93-e030-46b7-8da5-67a758cf5be0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:23.018685 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bea3ae93-e030-46b7-8da5-67a758cf5be0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:23.034682 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-bea3ae93-e030-46b7-8da5-67a758cf5be0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Getting quotas for project 093f88479eae442dba4d8320fbcb2b40. Resources: {'instances', 'ram', 'cores'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:41:23.038550 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-bea3ae93-e030-46b7-8da5-67a758cf5be0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Getting quotas for user a86c442d85e34a3487c8ad101045ee54 and project 093f88479eae442dba4d8320fbcb2b40. Resources: {'instances', 'ram', 'cores'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:41:23.050900 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-bea3ae93-e030-46b7-8da5-67a758cf5be0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Going to run 1 instances... {{(pid=124711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 15:41:23.053216 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-bea3ae93-e030-46b7-8da5-67a758cf5be0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: d3c4621e-4226-42bf-97f7-b65dbca2b1eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80914b1c-623c-42a8-810e-836b2cce0d3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 15:41:23.233336 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-bea3ae93-e030-46b7-8da5-67a758cf5be0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.885042 Jul 20 15:41:23.239752 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 487/978] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Jul 20 15:41:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 15:41:23.244289 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e817489b-c127-44b9-b5de-db07af21e7a1 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:23.245473 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e817489b-c127-44b9-b5de-db07af21e7a1 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: d3c4621e-4226-42bf-97f7-b65dbca2b1eb] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:23.300338 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-e817489b-c127-44b9-b5de-db07af21e7a1 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:23.307547 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-e817489b-c127-44b9-b5de-db07af21e7a1 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb" status: 200 len: 1214 microversion: 2.1 time: 0.067315 Jul 20 15:41:23.308223 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 492/979] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:23 2022] GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:24.329674 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-29f0c833-1fff-43df-87ca-567ac65a3629 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:24.330365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-29f0c833-1fff-43df-87ca-567ac65a3629 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: d3c4621e-4226-42bf-97f7-b65dbca2b1eb] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:24.386283 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-29f0c833-1fff-43df-87ca-567ac65a3629 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:24.393835 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-29f0c833-1fff-43df-87ca-567ac65a3629 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb" status: 200 len: 1214 microversion: 2.1 time: 0.068776 Jul 20 15:41:24.395026 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 488/980] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:24 2022] GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:25.411472 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-1f34566c-d3ca-4918-8d2f-f9b0e7ee80a1 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:25.412151 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-1f34566c-d3ca-4918-8d2f-f9b0e7ee80a1 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: d3c4621e-4226-42bf-97f7-b65dbca2b1eb] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:25.419998 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1f34566c-d3ca-4918-8d2f-f9b0e7ee80a1 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:25.420439 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1f34566c-d3ca-4918-8d2f-f9b0e7ee80a1 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:25.421186 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1f34566c-d3ca-4918-8d2f-f9b0e7ee80a1 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:25.421617 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1f34566c-d3ca-4918-8d2f-f9b0e7ee80a1 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:25.512938 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-1f34566c-d3ca-4918-8d2f-f9b0e7ee80a1 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:25.537178 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-1f34566c-d3ca-4918-8d2f-f9b0e7ee80a1 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb" status: 200 len: 1210 microversion: 2.1 time: 0.129458 Jul 20 15:41:25.538770 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 493/981] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:25 2022] GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb => generated 1210 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:26.555930 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-89282f43-7cd7-4732-b0a3-67a91b15ab8f tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:26.556556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-89282f43-7cd7-4732-b0a3-67a91b15ab8f tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: d3c4621e-4226-42bf-97f7-b65dbca2b1eb] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:26.564437 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-89282f43-7cd7-4732-b0a3-67a91b15ab8f tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:26.565186 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-89282f43-7cd7-4732-b0a3-67a91b15ab8f tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:26.565963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-89282f43-7cd7-4732-b0a3-67a91b15ab8f tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:26.566427 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-89282f43-7cd7-4732-b0a3-67a91b15ab8f tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:26.637370 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-89282f43-7cd7-4732-b0a3-67a91b15ab8f tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:26.640338 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:26.651712 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-89282f43-7cd7-4732-b0a3-67a91b15ab8f tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb" status: 200 len: 1284 microversion: 2.1 time: 0.099660 Jul 20 15:41:26.652646 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 489/982] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:26 2022] GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb => generated 1284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:27.669252 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-0c228f6c-c2d2-4520-b291-e94bb76b0230 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:27.670149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-0c228f6c-c2d2-4520-b291-e94bb76b0230 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: d3c4621e-4226-42bf-97f7-b65dbca2b1eb] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:27.677264 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0c228f6c-c2d2-4520-b291-e94bb76b0230 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:27.677835 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0c228f6c-c2d2-4520-b291-e94bb76b0230 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:27.678718 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0c228f6c-c2d2-4520-b291-e94bb76b0230 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:27.679385 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-0c228f6c-c2d2-4520-b291-e94bb76b0230 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:27.684222 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:27.825072 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-0c228f6c-c2d2-4520-b291-e94bb76b0230 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:27.833500 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-0c228f6c-c2d2-4520-b291-e94bb76b0230 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb" status: 200 len: 1314 microversion: 2.1 time: 0.167714 Jul 20 15:41:27.833610 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 494/983] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:27 2022] GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:28.851858 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-219e8f0d-f90d-476c-935f-6442efacffd3 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:28.853739 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-219e8f0d-f90d-476c-935f-6442efacffd3 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: d3c4621e-4226-42bf-97f7-b65dbca2b1eb] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:28.861956 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-219e8f0d-f90d-476c-935f-6442efacffd3 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:28.862430 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-219e8f0d-f90d-476c-935f-6442efacffd3 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:28.868174 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-863d0ef7-2de1-4ba4-b51c-f222d78d0dce req-5b940c66-d935-4acd-b38e-bdf01030f992 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3c4621e-4226-42bf-97f7-b65dbca2b1eb", "tag": "f3104024-5176-4e51-9240-4d34250b5e0e"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:41:28.875011 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-219e8f0d-f90d-476c-935f-6442efacffd3 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:28.875704 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-219e8f0d-f90d-476c-935f-6442efacffd3 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:28.883794 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-863d0ef7-2de1-4ba4-b51c-f222d78d0dce req-5b940c66-d935-4acd-b38e-bdf01030f992 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:28.884536 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-863d0ef7-2de1-4ba4-b51c-f222d78d0dce req-5b940c66-d935-4acd-b38e-bdf01030f992 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:28.896018 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-863d0ef7-2de1-4ba4-b51c-f222d78d0dce req-5b940c66-d935-4acd-b38e-bdf01030f992 service nova] Creating event network-changed:f3104024-5176-4e51-9240-4d34250b5e0e for instance d3c4621e-4226-42bf-97f7-b65dbca2b1eb on hv-cinder-81914 Jul 20 15:41:28.901014 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-863d0ef7-2de1-4ba4-b51c-f222d78d0dce req-5b940c66-d935-4acd-b38e-bdf01030f992 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036794 Jul 20 15:41:28.901775 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 495/984] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:41:29.091699 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-219e8f0d-f90d-476c-935f-6442efacffd3 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:29.099344 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-219e8f0d-f90d-476c-935f-6442efacffd3 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb" status: 200 len: 1314 microversion: 2.1 time: 0.253256 Jul 20 15:41:29.100305 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 490/985] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:28 2022] GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:30.118625 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-27843c11-3806-4c96-acb1-354bc4b1c3f8 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:30.124211 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-27843c11-3806-4c96-acb1-354bc4b1c3f8 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: d3c4621e-4226-42bf-97f7-b65dbca2b1eb] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:30.131477 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-27843c11-3806-4c96-acb1-354bc4b1c3f8 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:30.131922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-27843c11-3806-4c96-acb1-354bc4b1c3f8 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:30.132685 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-27843c11-3806-4c96-acb1-354bc4b1c3f8 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:30.133303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-27843c11-3806-4c96-acb1-354bc4b1c3f8 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:30.399610 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-27843c11-3806-4c96-acb1-354bc4b1c3f8 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:30.408496 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-27843c11-3806-4c96-acb1-354bc4b1c3f8 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb" status: 200 len: 1314 microversion: 2.1 time: 0.295140 Jul 20 15:41:30.409088 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 496/986] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:30 2022] GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:31.427376 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-1a368d5a-4b1a-4fbf-8fbd-088ae5b1e4d5 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:31.427985 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-1a368d5a-4b1a-4fbf-8fbd-088ae5b1e4d5 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: d3c4621e-4226-42bf-97f7-b65dbca2b1eb] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:31.431142 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:31.437649 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1a368d5a-4b1a-4fbf-8fbd-088ae5b1e4d5 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:31.438362 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1a368d5a-4b1a-4fbf-8fbd-088ae5b1e4d5 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:31.439136 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1a368d5a-4b1a-4fbf-8fbd-088ae5b1e4d5 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:31.439848 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1a368d5a-4b1a-4fbf-8fbd-088ae5b1e4d5 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:31.617705 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-1a368d5a-4b1a-4fbf-8fbd-088ae5b1e4d5 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:31.625633 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-1a368d5a-4b1a-4fbf-8fbd-088ae5b1e4d5 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb" status: 200 len: 1314 microversion: 2.1 time: 0.202349 Jul 20 15:41:31.626212 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 491/987] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:31 2022] GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:32.644235 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-3d3f1fd0-9abb-46af-ba89-b5ea041e28ee tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:32.645965 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-3d3f1fd0-9abb-46af-ba89-b5ea041e28ee tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: d3c4621e-4226-42bf-97f7-b65dbca2b1eb] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:32.649353 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:32.656006 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3d3f1fd0-9abb-46af-ba89-b5ea041e28ee tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:32.656464 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3d3f1fd0-9abb-46af-ba89-b5ea041e28ee tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:32.657290 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3d3f1fd0-9abb-46af-ba89-b5ea041e28ee tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:32.657734 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3d3f1fd0-9abb-46af-ba89-b5ea041e28ee tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:32.817782 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-3d3f1fd0-9abb-46af-ba89-b5ea041e28ee tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:32.827780 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-3d3f1fd0-9abb-46af-ba89-b5ea041e28ee tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb" status: 200 len: 1314 microversion: 2.1 time: 0.186574 Jul 20 15:41:32.829617 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 497/988] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:32 2022] GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:33.847040 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d9cd7e90-6503-4959-9277-02339da48471 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:33.847839 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-d9cd7e90-6503-4959-9277-02339da48471 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: d3c4621e-4226-42bf-97f7-b65dbca2b1eb] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:33.850680 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=2 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:33.858140 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d9cd7e90-6503-4959-9277-02339da48471 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:33.858874 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d9cd7e90-6503-4959-9277-02339da48471 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:33.859791 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d9cd7e90-6503-4959-9277-02339da48471 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:33.860519 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d9cd7e90-6503-4959-9277-02339da48471 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:34.057507 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d9cd7e90-6503-4959-9277-02339da48471 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:34.069007 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d9cd7e90-6503-4959-9277-02339da48471 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb" status: 200 len: 1314 microversion: 2.1 time: 0.227084 Jul 20 15:41:34.071629 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 492/989] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:33 2022] GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:34.347612 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-97e1f6f2-ca37-431e-966f-2ff258224bb3 req-feefc4af-14b3-4b95-bbf9-d6234c721631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c4621e-4226-42bf-97f7-b65dbca2b1eb", "name": "network-vif-plugged", "status": "completed", "tag": "f3104024-5176-4e51-9240-4d34250b5e0e"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:41:34.356118 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=2 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:34.359078 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-97e1f6f2-ca37-431e-966f-2ff258224bb3 req-feefc4af-14b3-4b95-bbf9-d6234c721631 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:34.360273 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-97e1f6f2-ca37-431e-966f-2ff258224bb3 req-feefc4af-14b3-4b95-bbf9-d6234c721631 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:34.379143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-97e1f6f2-ca37-431e-966f-2ff258224bb3 req-feefc4af-14b3-4b95-bbf9-d6234c721631 service nova] Creating event network-vif-plugged:f3104024-5176-4e51-9240-4d34250b5e0e for instance d3c4621e-4226-42bf-97f7-b65dbca2b1eb on hv-cinder-81914 Jul 20 15:41:34.385251 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-97e1f6f2-ca37-431e-966f-2ff258224bb3 req-feefc4af-14b3-4b95-bbf9-d6234c721631 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041070 Jul 20 15:41:34.389283 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 498/990] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:41:35.101932 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ac939a5c-5786-472c-a5ca-23ed042cad8b tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:35.108661 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ac939a5c-5786-472c-a5ca-23ed042cad8b tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: d3c4621e-4226-42bf-97f7-b65dbca2b1eb] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:35.112791 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=8 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:35.116718 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ac939a5c-5786-472c-a5ca-23ed042cad8b tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:35.117496 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ac939a5c-5786-472c-a5ca-23ed042cad8b tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:35.118938 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ac939a5c-5786-472c-a5ca-23ed042cad8b tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:35.119819 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ac939a5c-5786-472c-a5ca-23ed042cad8b tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:35.294811 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-ac939a5c-5786-472c-a5ca-23ed042cad8b tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:35.302714 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-ac939a5c-5786-472c-a5ca-23ed042cad8b tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb" status: 200 len: 1314 microversion: 2.1 time: 0.218792 Jul 20 15:41:35.303328 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 493/991] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:35 2022] GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:36.323314 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-834273a8-c049-45b5-8d7a-f6551f0cccaf tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:36.324878 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-834273a8-c049-45b5-8d7a-f6551f0cccaf tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: d3c4621e-4226-42bf-97f7-b65dbca2b1eb] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:36.332932 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-834273a8-c049-45b5-8d7a-f6551f0cccaf tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:36.334765 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-834273a8-c049-45b5-8d7a-f6551f0cccaf tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:36.334765 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-834273a8-c049-45b5-8d7a-f6551f0cccaf tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:36.335102 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-834273a8-c049-45b5-8d7a-f6551f0cccaf tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:36.550989 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-834273a8-c049-45b5-8d7a-f6551f0cccaf tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:36.559328 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-834273a8-c049-45b5-8d7a-f6551f0cccaf tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb" status: 200 len: 1314 microversion: 2.1 time: 0.242300 Jul 20 15:41:36.560188 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 499/992] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:36 2022] GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:41:36.898904 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-60c5bd47-c1d1-4294-ad13-92de18014e35 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:36.903647 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-60c5bd47-c1d1-4294-ad13-92de18014e35 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:36.909950 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-60c5bd47-c1d1-4294-ad13-92de18014e35 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:36.910437 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-60c5bd47-c1d1-4294-ad13-92de18014e35 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:36.911207 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-60c5bd47-c1d1-4294-ad13-92de18014e35 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:36.911806 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-60c5bd47-c1d1-4294-ad13-92de18014e35 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:36.949814 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-60c5bd47-c1d1-4294-ad13-92de18014e35 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade/ips" status: 200 len: 150 microversion: 2.1 time: 0.054599 Jul 20 15:41:36.952031 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 494/993] 10.222.0.78 () {58 vars in 1247 bytes} [Wed Jul 20 15:41:36 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade/ips => generated 150 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:41:37.577464 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-3073e1dc-49d6-42fe-b79e-ce3936816d7e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:37.578081 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-3073e1dc-49d6-42fe-b79e-ce3936816d7e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: d3c4621e-4226-42bf-97f7-b65dbca2b1eb] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:37.585154 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3073e1dc-49d6-42fe-b79e-ce3936816d7e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:37.585700 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3073e1dc-49d6-42fe-b79e-ce3936816d7e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:37.586596 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3073e1dc-49d6-42fe-b79e-ce3936816d7e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:37.587148 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-3073e1dc-49d6-42fe-b79e-ce3936816d7e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:37.863238 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-3073e1dc-49d6-42fe-b79e-ce3936816d7e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:37.882046 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-3073e1dc-49d6-42fe-b79e-ce3936816d7e tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb" status: 200 len: 1498 microversion: 2.1 time: 0.309456 Jul 20 15:41:37.882782 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 500/994] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:37 2022] GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb => generated 1498 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:38.430594 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-debf5ce6-6649-4bf3-ae5c-6bba08b3c317 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Action: 'create', calling method: .version_select at 0x7efd90954c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1520672230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLd5hXNnt3Vr5aobx+Kh2yJY4cDtqVBmL7CJgwVoxAH4IDm0RgI1Rx82k7R4ZYqPXh3ZWtqBzSqicZ64Tr+l9DVWNqNEjuhzHiCsu3MMb27CUjRIUe0YSfkbVAxF1sUCLA=="}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:41:38.444961 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-debf5ce6-6649-4bf3-ae5c-6bba08b3c317 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Getting quotas for project 68372ee91fb843108d3b0cb1c99cd186. Resources: {'key_pairs'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:41:38.450325 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-debf5ce6-6649-4bf3-ae5c-6bba08b3c317 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Getting quotas for user cb4dc884b7eb4aa8a0adcdb46c5f9586 and project 68372ee91fb843108d3b0cb1c99cd186. Resources: {'key_pairs'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:41:38.569609 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-debf5ce6-6649-4bf3-ae5c-6bba08b3c317 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.388504 Jul 20 15:41:38.570206 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 495/995] 10.222.0.78 () {60 vars in 1158 bytes} [Wed Jul 20 15:41:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:41:38.873700 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-dbb88632-96bd-4e0f-88d2-42ce4fe49442 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61f2112e-84e1-402f-9852-1f69ae523016"}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:41:38.874796 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-dbb88632-96bd-4e0f-88d2-42ce4fe49442 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:38.882774 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dbb88632-96bd-4e0f-88d2-42ce4fe49442 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:38.883500 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dbb88632-96bd-4e0f-88d2-42ce4fe49442 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:38.884592 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dbb88632-96bd-4e0f-88d2-42ce4fe49442 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:38.885031 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-dbb88632-96bd-4e0f-88d2-42ce4fe49442 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:39.066998 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-68ac81f8-e865-465c-9909-4dc125949e1d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:39.067501 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-68ac81f8-e865-465c-9909-4dc125949e1d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: d3c4621e-4226-42bf-97f7-b65dbca2b1eb] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:39.079617 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-68ac81f8-e865-465c-9909-4dc125949e1d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:39.080069 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-68ac81f8-e865-465c-9909-4dc125949e1d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:39.080842 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-68ac81f8-e865-465c-9909-4dc125949e1d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:39.081288 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-68ac81f8-e865-465c-9909-4dc125949e1d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:39.107368 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-68ac81f8-e865-465c-9909-4dc125949e1d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: d3c4621e-4226-42bf-97f7-b65dbca2b1eb] Going to try to terminate instance {{(pid=124711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 15:41:39.533721 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-68ac81f8-e865-465c-9909-4dc125949e1d tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb" status: 204 len: 0 microversion: 2.1 time: 0.470354 Jul 20 15:41:39.534573 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 496/996] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:41:39 2022] DELETE /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb => generated 0 bytes in 472 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 15:41:39.542980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-76567738-5bc9-4793-bcb1-fdce18f878d0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:39.543720 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-76567738-5bc9-4793-bcb1-fdce18f878d0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: d3c4621e-4226-42bf-97f7-b65dbca2b1eb] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:39.549590 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-76567738-5bc9-4793-bcb1-fdce18f878d0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:39.550045 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-76567738-5bc9-4793-bcb1-fdce18f878d0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:39.550894 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-76567738-5bc9-4793-bcb1-fdce18f878d0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:39.551293 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-76567738-5bc9-4793-bcb1-fdce18f878d0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:39.708992 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-76567738-5bc9-4793-bcb1-fdce18f878d0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:39.719376 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-76567738-5bc9-4793-bcb1-fdce18f878d0 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb" status: 200 len: 1504 microversion: 2.1 time: 0.180539 Jul 20 15:41:39.720213 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 497/997] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:39 2022] GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:41:39.887229 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-dbb88632-96bd-4e0f-88d2-42ce4fe49442 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "POST /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.016901 Jul 20 15:41:39.889280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 501/998] 10.222.0.78 () {60 vars in 1322 bytes} [Wed Jul 20 15:41:38 2022] POST /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade/os-volume_attachments => generated 194 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:41:40.737127 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-1685ae9f-ca6d-4fd3-8979-ee1f89c3dddf tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:40.738609 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-1685ae9f-ca6d-4fd3-8979-ee1f89c3dddf tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: d3c4621e-4226-42bf-97f7-b65dbca2b1eb] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:40.745323 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1685ae9f-ca6d-4fd3-8979-ee1f89c3dddf tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:40.746172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1685ae9f-ca6d-4fd3-8979-ee1f89c3dddf tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:40.747214 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1685ae9f-ca6d-4fd3-8979-ee1f89c3dddf tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:40.747870 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1685ae9f-ca6d-4fd3-8979-ee1f89c3dddf tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:40.926710 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-1685ae9f-ca6d-4fd3-8979-ee1f89c3dddf tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:40.935747 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-1685ae9f-ca6d-4fd3-8979-ee1f89c3dddf tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb" status: 200 len: 1504 microversion: 2.1 time: 0.202390 Jul 20 15:41:40.937257 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 498/999] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:40 2022] GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb => generated 1504 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:41.758885 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-8f11e19b-bd19-4165-8b93-f8fe7755c135 req-e072a81e-9f08-43c0-a559-e1b590ff7d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c4621e-4226-42bf-97f7-b65dbca2b1eb", "name": "network-vif-deleted", "tag": "f3104024-5176-4e51-9240-4d34250b5e0e"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:41:41.778461 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-8f11e19b-bd19-4165-8b93-f8fe7755c135 req-e072a81e-9f08-43c0-a559-e1b590ff7d30 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:41.779861 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-8f11e19b-bd19-4165-8b93-f8fe7755c135 req-e072a81e-9f08-43c0-a559-e1b590ff7d30 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:41.803009 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-8f11e19b-bd19-4165-8b93-f8fe7755c135 req-e072a81e-9f08-43c0-a559-e1b590ff7d30 service nova] Creating event network-vif-deleted:f3104024-5176-4e51-9240-4d34250b5e0e for instance d3c4621e-4226-42bf-97f7-b65dbca2b1eb on hv-cinder-81914 Jul 20 15:41:41.815252 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-8f11e19b-bd19-4165-8b93-f8fe7755c135 req-e072a81e-9f08-43c0-a559-e1b590ff7d30 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066071 Jul 20 15:41:41.815252 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 502/1000] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:41:41.956683 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5a2af39e-f519-47e4-9852-75d7a31a4fca tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:41.957784 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5a2af39e-f519-47e4-9852-75d7a31a4fca tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: d3c4621e-4226-42bf-97f7-b65dbca2b1eb] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:41.982510 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5a2af39e-f519-47e4-9852-75d7a31a4fca tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:41.983169 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5a2af39e-f519-47e4-9852-75d7a31a4fca tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:41.984832 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5a2af39e-f519-47e4-9852-75d7a31a4fca tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:41.985994 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5a2af39e-f519-47e4-9852-75d7a31a4fca tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:42.105710 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5a2af39e-f519-47e4-9852-75d7a31a4fca tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a86c442d85e34a3487c8ad101045ee54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093f88479eae442dba4d8320fbcb2b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:42.120981 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5a2af39e-f519-47e4-9852-75d7a31a4fca tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb" status: 200 len: 1299 microversion: 2.1 time: 0.170621 Jul 20 15:41:42.121911 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 499/1001] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:41 2022] GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb => generated 1299 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:41:43.140652 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-89195650-634c-4dc8-b066-19bd32306f20 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:43.142168 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-89195650-634c-4dc8-b066-19bd32306f20 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] [instance: d3c4621e-4226-42bf-97f7-b65dbca2b1eb] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:43.154734 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-89195650-634c-4dc8-b066-19bd32306f20 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:43.155709 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-89195650-634c-4dc8-b066-19bd32306f20 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:43.156994 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-89195650-634c-4dc8-b066-19bd32306f20 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:43.157682 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-89195650-634c-4dc8-b066-19bd32306f20 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:43.189818 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-89195650-634c-4dc8-b066-19bd32306f20 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] HTTP exception thrown: Instance d3c4621e-4226-42bf-97f7-b65dbca2b1eb could not be found. Jul 20 15:41:43.193862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-89195650-634c-4dc8-b066-19bd32306f20 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Request method failure captured: Jul 20 15:41:43.193862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb HTTP/1.1 Jul 20 15:41:43.193862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:41:43.193862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:41:43.193862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:41:43.193862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:41:43.193862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:41:43.193862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:41:43.193862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:41:43.193862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:41:43.193862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2CIKWhL3oKkuHP0J69ZhEq90KYrMw3l0L8kKqSRhknQt5tEoi44y_tuMJUfHqsjCTaVYRstp1r_T5n6yn2_a_QdAcIHBltFBOnLaDSUbV_Hb3BvK6dNZF0oIH8BBufsR91u8HV6vfYZKNX4ipiER9GQ15sVIC_cE7KJuw8VXzvRSGYQ Jul 20 15:41:43.193862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:41:43.193862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:41:43.193862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:41:43.193862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:41:43.193862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:41:43.193862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:41:43.193862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 093f88479eae442dba4d8320fbcb2b40 Jul 20 15:41:43.193862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-VolumesActionsTest-1826082824 Jul 20 15:41:43.193862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:41:43.193862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:41:43.197434 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/093f88479eae442dba4d8320fbcb2b40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/093f88479eae442dba4d8320fbcb2b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_093f88479eae442dba4d8320fbcb2b40", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/093f88479eae442dba4d8320fbcb2b40"}]}] Jul 20 15:41:43.197434 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-VolumesActionsTest-1826082824 Jul 20 15:41:43.197434 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 093f88479eae442dba4d8320fbcb2b40 Jul 20 15:41:43.197434 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-VolumesActionsTest-1826082824 Jul 20 15:41:43.197434 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-VolumesActionsTest-1826082824-project Jul 20 15:41:43.197434 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:41:43.197434 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:41:43.197434 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: a86c442d85e34a3487c8ad101045ee54 Jul 20 15:41:43.197434 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-VolumesActionsTest-1826082824-project Jul 20 15:41:43.197434 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:41:43.197434 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance d3c4621e-4226-42bf-97f7-b65dbca2b1eb could not be found. Jul 20 15:41:43.197434 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': 'd3c4621e-4226-42bf-97f7-b65dbca2b1eb'} Jul 20 15:41:43.199638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:41:43.199638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:41:43.199638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:41:43.199638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:41:43.199638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:41:43.199638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:41:43.199638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:41:43.199638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:41:43.199638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:41:43.199638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:41:43.199638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3c4621e-4226-42bf-97f7-b65dbca2b1eb could not be found. Jul 20 15:41:43.199638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:41:43.199638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:41:43.199638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:41:43.199638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:41:43.199638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:41:43.199638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:41:43.199638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:41:43.199638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:41:43.199638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:41:43.210331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:41:43.210331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:41:43.210331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:41:43.210331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:41:43.210331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:41:43.210331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:41:43.210331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:41:43.210331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3c4621e-4226-42bf-97f7-b65dbca2b1eb could not be found. Jul 20 15:41:43.210331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:41:43.210331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:41:43.210331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:41:43.210331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:41:43.210331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:41:43.210331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:41:43.210331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:41:43.210331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:41:43.210331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3c4621e-4226-42bf-97f7-b65dbca2b1eb could not be found. Jul 20 15:41:43.210331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:41:43.212243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-89195650-634c-4dc8-b066-19bd32306f20 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] Returning 404 to user: Instance d3c4621e-4226-42bf-97f7-b65dbca2b1eb could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:41:43.212243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-89195650-634c-4dc8-b066-19bd32306f20 tempest-VolumesActionsTest-1826082824 tempest-VolumesActionsTest-1826082824-project] 10.222.0.78 "GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb" status: 404 len: 111 microversion: 2.1 time: 0.061159 Jul 20 15:41:43.212243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 503/1002] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:43 2022] GET /compute/v2.1/servers/d3c4621e-4226-42bf-97f7-b65dbca2b1eb => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 15:41:49.720491 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e54bd064-75ce-42d5-9996-f0ebc3e22c08 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61f2112e-84e1-402f-9852-1f69ae523016"}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:41:49.722040 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e54bd064-75ce-42d5-9996-f0ebc3e22c08 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:49.726834 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=4 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:49.731856 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e54bd064-75ce-42d5-9996-f0ebc3e22c08 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:49.732310 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e54bd064-75ce-42d5-9996-f0ebc3e22c08 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:49.733277 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e54bd064-75ce-42d5-9996-f0ebc3e22c08 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:49.733809 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e54bd064-75ce-42d5-9996-f0ebc3e22c08 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:49.991189 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-e54bd064-75ce-42d5-9996-f0ebc3e22c08 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] HTTP exception thrown: Invalid volume: volume 61f2112e-84e1-402f-9852-1f69ae523016 is already attached to instances: 34721a3c-bac8-4cea-9f1d-6ee067b62ade Jul 20 15:41:49.993151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e54bd064-75ce-42d5-9996-f0ebc3e22c08 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Request method failure captured: Jul 20 15:41:49.993151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: POST /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade/os-volume_attachments HTTP/1.1 Jul 20 15:41:49.993151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:41:49.993151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:41:49.993151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:41:49.993151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 74 Jul 20 15:41:49.993151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:41:49.993151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:41:49.993151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:41:49.993151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:41:49.993151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2CFbqu0igtNFkKl4EJaf-GYNIGNf3oPPBh1qR18PSUtcU3V7h-gnPvG3ab7Q5raWMuBmdNqsnWfQ6CrhGLfn4khb0o1UjxQU3L4Zqn7IpPmYId2n8OkZqafcLgphEQCenF6dSjPlKmYhLi2C6LeB66jmX3oFU2bTLIqjrnHhkVSptBA Jul 20 15:41:49.993151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:41:49.993151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:41:49.993151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:41:49.993151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:41:49.993151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:41:49.993151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:41:49.993151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:41:49.993151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:41:49.993151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:41:49.993151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:41:49.994631 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dc2a5c754d42d1862b331afef2183f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}] Jul 20 15:41:49.994631 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:41:49.994631 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:41:49.994631 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:41:49.994631 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:41:49.994631 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:41:49.994631 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:41:49.994631 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: 0235b8fe92554131ba30e1d18f0f2d86 Jul 20 15:41:49.994631 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:41:49.994631 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Jul 20 15:41:49.994631 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {"volumeAttachment": {"volumeId": "61f2112e-84e1-402f-9852-1f69ae523016"}} Jul 20 15:41:49.994631 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: > Jul 20 15:41:49.996202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Invalid volume: volume 61f2112e-84e1-402f-9852-1f69ae523016 is already attached to instances: 34721a3c-bac8-4cea-9f1d-6ee067b62ade Jul 20 15:41:49.996202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'server_id': '34721a3c-bac8-4cea-9f1d-6ee067b62ade', 'body': {'volumeAttachment': {'volumeId': '61f2112e-84e1-402f-9852-1f69ae523016'}}} Jul 20 15:41:49.996202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:41:49.996202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:41:49.996202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 15:41:49.996202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 15:41:49.996202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 15:41:49.996202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 15:41:49.996202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 15:41:49.996202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 15:41:49.996202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 15:41:49.996202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 15:41:49.996202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 15:41:49.996202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 15:41:49.996202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 61f2112e-84e1-402f-9852-1f69ae523016 is already attached to instances: 34721a3c-bac8-4cea-9f1d-6ee067b62ade Jul 20 15:41:49.996202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:41:49.996202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:41:49.996202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:41:49.996202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:41:49.997772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:41:49.997772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:41:49.997772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:41:49.997772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:41:49.997772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:41:49.997772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:41:49.997772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 15:41:49.997772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 15:41:49.997772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 15:41:49.997772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 15:41:49.997772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 15:41:49.997772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 15:41:49.997772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 15:41:49.997772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 15:41:49.997772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 61f2112e-84e1-402f-9852-1f69ae523016 is already attached to instances: 34721a3c-bac8-4cea-9f1d-6ee067b62ade Jul 20 15:41:49.997772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:41:49.997772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:41:49.997772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:41:49.997772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:41:49.997772 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:41:49.999807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:41:49.999807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:41:49.999807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:41:49.999807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 61f2112e-84e1-402f-9852-1f69ae523016 is already attached to instances: 34721a3c-bac8-4cea-9f1d-6ee067b62ade Jul 20 15:41:49.999807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:41:49.999807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e54bd064-75ce-42d5-9996-f0ebc3e22c08 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Returning 400 to user: Invalid volume: volume 61f2112e-84e1-402f-9852-1f69ae523016 is already attached to instances: 34721a3c-bac8-4cea-9f1d-6ee067b62ade {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:41:49.999807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e54bd064-75ce-42d5-9996-f0ebc3e22c08 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "POST /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.280086 Jul 20 15:41:49.999807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 500/1003] 10.222.0.78 () {60 vars in 1322 bytes} [Wed Jul 20 15:41:49 2022] POST /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade/os-volume_attachments => generated 174 bytes in 282 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 15:41:50.071502 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-2df1e1ab-4460-4f61-9b4f-a33c8bb087ee tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:50.072741 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-2df1e1ab-4460-4f61-9b4f-a33c8bb087ee tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:50.080926 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2df1e1ab-4460-4f61-9b4f-a33c8bb087ee tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:50.081623 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2df1e1ab-4460-4f61-9b4f-a33c8bb087ee tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:50.082507 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2df1e1ab-4460-4f61-9b4f-a33c8bb087ee tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:50.085917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2df1e1ab-4460-4f61-9b4f-a33c8bb087ee tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:50.253128 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.objects.instance [None req-2df1e1ab-4460-4f61-9b4f-a33c8bb087ee tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lazy-loading 'services' on Instance uuid 34721a3c-bac8-4cea-9f1d-6ee067b62ade {{(pid=124712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:41:50.482332 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-2df1e1ab-4460-4f61-9b4f-a33c8bb087ee tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "DELETE /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade/os-volume_attachments/61f2112e-84e1-402f-9852-1f69ae523016" status: 202 len: 0 microversion: 2.1 time: 0.414544 Jul 20 15:41:50.492177 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 504/1004] 10.222.0.78 () {58 vars in 1415 bytes} [Wed Jul 20 15:41:50 2022] DELETE /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade/os-volume_attachments/61f2112e-84e1-402f-9852-1f69ae523016 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:41:50.492424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-974713d6-5de9-4ccc-9817-7a12b32a91f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:50.493304 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-974713d6-5de9-4ccc-9817-7a12b32a91f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:50.502170 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-974713d6-5de9-4ccc-9817-7a12b32a91f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:50.502659 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-974713d6-5de9-4ccc-9817-7a12b32a91f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:50.503462 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-974713d6-5de9-4ccc-9817-7a12b32a91f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:50.503922 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-974713d6-5de9-4ccc-9817-7a12b32a91f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:50.542761 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-974713d6-5de9-4ccc-9817-7a12b32a91f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054655 Jul 20 15:41:50.543421 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 501/1005] 10.222.0.78 () {58 vars in 1301 bytes} [Wed Jul 20 15:41:50 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:41:51.555864 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-2424d695-f070-42a0-a544-289be64377f9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:51.556849 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-2424d695-f070-42a0-a544-289be64377f9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:51.564250 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2424d695-f070-42a0-a544-289be64377f9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:51.567108 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2424d695-f070-42a0-a544-289be64377f9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:51.567108 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2424d695-f070-42a0-a544-289be64377f9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:51.567108 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2424d695-f070-42a0-a544-289be64377f9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:51.597060 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-2424d695-f070-42a0-a544-289be64377f9 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046053 Jul 20 15:41:51.601473 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 505/1006] 10.222.0.78 () {58 vars in 1301 bytes} [Wed Jul 20 15:41:51 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:41:52.609354 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ab4701e4-de5e-4568-b3ae-7e526a063ac0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:52.610452 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ab4701e4-de5e-4568-b3ae-7e526a063ac0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:52.617857 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ab4701e4-de5e-4568-b3ae-7e526a063ac0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:52.618334 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ab4701e4-de5e-4568-b3ae-7e526a063ac0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:52.619139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ab4701e4-de5e-4568-b3ae-7e526a063ac0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:52.619688 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ab4701e4-de5e-4568-b3ae-7e526a063ac0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:52.650091 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-ab4701e4-de5e-4568-b3ae-7e526a063ac0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045632 Jul 20 15:41:52.650811 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 502/1007] 10.222.0.78 () {58 vars in 1301 bytes} [Wed Jul 20 15:41:52 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 15:41:52.716898 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-fd6ac4b3-fa4c-4c70-bdbb-2c2956d3fc2f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:52.717473 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-fd6ac4b3-fa4c-4c70-bdbb-2c2956d3fc2f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:52.727294 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fd6ac4b3-fa4c-4c70-bdbb-2c2956d3fc2f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:52.737291 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fd6ac4b3-fa4c-4c70-bdbb-2c2956d3fc2f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:52.737291 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fd6ac4b3-fa4c-4c70-bdbb-2c2956d3fc2f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:52.737291 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fd6ac4b3-fa4c-4c70-bdbb-2c2956d3fc2f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:52.757759 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-fd6ac4b3-fa4c-4c70-bdbb-2c2956d3fc2f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Going to try to terminate instance {{(pid=124712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 15:41:53.276905 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-fd6ac4b3-fa4c-4c70-bdbb-2c2956d3fc2f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "DELETE /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade" status: 204 len: 0 microversion: 2.1 time: 0.565165 Jul 20 15:41:53.277614 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 506/1008] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:41:52 2022] DELETE /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 15:41:53.285731 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-2e9d86f6-8bce-468a-bb24-d257c61a07e3 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:53.286385 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-2e9d86f6-8bce-468a-bb24-d257c61a07e3 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:53.293956 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2e9d86f6-8bce-468a-bb24-d257c61a07e3 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:53.298311 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2e9d86f6-8bce-468a-bb24-d257c61a07e3 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:53.298311 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2e9d86f6-8bce-468a-bb24-d257c61a07e3 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:53.298311 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-2e9d86f6-8bce-468a-bb24-d257c61a07e3 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:53.446227 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-2e9d86f6-8bce-468a-bb24-d257c61a07e3 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:53.455244 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-2e9d86f6-8bce-468a-bb24-d257c61a07e3 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade" status: 200 len: 1681 microversion: 2.1 time: 0.173300 Jul 20 15:41:53.455871 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 503/1009] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:53 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:54.475750 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-ad5a39a2-bc69-4ce2-b467-da0f8d140756 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:54.476592 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-ad5a39a2-bc69-4ce2-b467-da0f8d140756 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:54.484011 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ad5a39a2-bc69-4ce2-b467-da0f8d140756 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:54.484470 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ad5a39a2-bc69-4ce2-b467-da0f8d140756 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:54.485700 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ad5a39a2-bc69-4ce2-b467-da0f8d140756 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:54.486524 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ad5a39a2-bc69-4ce2-b467-da0f8d140756 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:54.643146 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-ad5a39a2-bc69-4ce2-b467-da0f8d140756 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:54.652494 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-ad5a39a2-bc69-4ce2-b467-da0f8d140756 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade" status: 200 len: 1681 microversion: 2.1 time: 0.181224 Jul 20 15:41:54.662454 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 507/1010] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:54 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:55.014294 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 15:41:55.014294 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Wed Jul 20 15:41:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 15:41:55.672886 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-bcb62e76-9581-41c1-ba79-2c1c2a7d9653 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:55.686713 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-bcb62e76-9581-41c1-ba79-2c1c2a7d9653 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:55.703464 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bcb62e76-9581-41c1-ba79-2c1c2a7d9653 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:55.703854 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bcb62e76-9581-41c1-ba79-2c1c2a7d9653 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:55.709104 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bcb62e76-9581-41c1-ba79-2c1c2a7d9653 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:55.711498 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bcb62e76-9581-41c1-ba79-2c1c2a7d9653 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:55.884728 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-bcb62e76-9581-41c1-ba79-2c1c2a7d9653 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:55.893015 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-bcb62e76-9581-41c1-ba79-2c1c2a7d9653 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade" status: 200 len: 1681 microversion: 2.1 time: 0.226441 Jul 20 15:41:55.893579 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 504/1011] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:55 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade => generated 1681 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:56.377808 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-df7dfb1b-2a0f-4f91-b99d-68ebc3993182 req-0308374a-df5f-4bf3-8f70-b3f51bac578d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34721a3c-bac8-4cea-9f1d-6ee067b62ade", "name": "network-vif-deleted", "tag": "23194b35-e97d-47c2-b0aa-7ba393259924"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:41:56.377808 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-df7dfb1b-2a0f-4f91-b99d-68ebc3993182 req-0308374a-df5f-4bf3-8f70-b3f51bac578d service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:56.377808 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-df7dfb1b-2a0f-4f91-b99d-68ebc3993182 req-0308374a-df5f-4bf3-8f70-b3f51bac578d service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:56.377808 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-df7dfb1b-2a0f-4f91-b99d-68ebc3993182 req-0308374a-df5f-4bf3-8f70-b3f51bac578d service nova] Creating event network-vif-deleted:23194b35-e97d-47c2-b0aa-7ba393259924 for instance 34721a3c-bac8-4cea-9f1d-6ee067b62ade on hv-cinder-81914 Jul 20 15:41:56.380097 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-df7dfb1b-2a0f-4f91-b99d-68ebc3993182 req-0308374a-df5f-4bf3-8f70-b3f51bac578d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042841 Jul 20 15:41:56.434875 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 508/1012] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:41:56.915899 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-a1c9beb7-a067-4918-ac04-e22bcff6fd9c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:56.917738 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-a1c9beb7-a067-4918-ac04-e22bcff6fd9c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:56.927605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a1c9beb7-a067-4918-ac04-e22bcff6fd9c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:56.928416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a1c9beb7-a067-4918-ac04-e22bcff6fd9c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:56.930330 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a1c9beb7-a067-4918-ac04-e22bcff6fd9c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:56.931434 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a1c9beb7-a067-4918-ac04-e22bcff6fd9c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:57.010141 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a1c9beb7-a067-4918-ac04-e22bcff6fd9c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:57.011010 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-a1c9beb7-a067-4918-ac04-e22bcff6fd9c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:57.011746 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.objects.instance [None req-a1c9beb7-a067-4918-ac04-e22bcff6fd9c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lazy-loading 'fault' on Instance uuid 34721a3c-bac8-4cea-9f1d-6ee067b62ade {{(pid=124711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:41:57.063448 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-a1c9beb7-a067-4918-ac04-e22bcff6fd9c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:41:57.067033 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:41:57.071807 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-a1c9beb7-a067-4918-ac04-e22bcff6fd9c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade" status: 200 len: 1331 microversion: 2.1 time: 0.162868 Jul 20 15:41:57.082672 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 505/1013] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:56 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade => generated 1331 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:41:58.090203 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-acb7cc4f-5dfa-44ab-b82a-be9f483d482e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:58.090939 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-acb7cc4f-5dfa-44ab-b82a-be9f483d482e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:41:58.097882 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-acb7cc4f-5dfa-44ab-b82a-be9f483d482e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:58.098355 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-acb7cc4f-5dfa-44ab-b82a-be9f483d482e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:58.099128 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-acb7cc4f-5dfa-44ab-b82a-be9f483d482e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:41:58.099567 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-acb7cc4f-5dfa-44ab-b82a-be9f483d482e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:41:58.113714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-acb7cc4f-5dfa-44ab-b82a-be9f483d482e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] HTTP exception thrown: Instance 34721a3c-bac8-4cea-9f1d-6ee067b62ade could not be found. Jul 20 15:41:58.115399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-acb7cc4f-5dfa-44ab-b82a-be9f483d482e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Request method failure captured: Jul 20 15:41:58.115399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade HTTP/1.1 Jul 20 15:41:58.115399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:41:58.115399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:41:58.115399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:41:58.115399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:41:58.115399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:41:58.115399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:41:58.115399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:41:58.115399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:41:58.115399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2CFbqu0igtNFkKl4EJaf-GYNIGNf3oPPBh1qR18PSUtcU3V7h-gnPvG3ab7Q5raWMuBmdNqsnWfQ6CrhGLfn4khb0o1UjxQU3L4Zqn7IpPmYId2n8OkZqafcLgphEQCenF6dSjPlKmYhLi2C6LeB66jmX3oFU2bTLIqjrnHhkVSptBA Jul 20 15:41:58.115399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:41:58.115399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:41:58.115399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:41:58.115399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:41:58.115399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:41:58.115399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:41:58.115399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:41:58.115399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:41:58.115399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:41:58.115399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:41:58.117654 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dc2a5c754d42d1862b331afef2183f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}] Jul 20 15:41:58.117654 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:41:58.117654 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:41:58.117654 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:41:58.117654 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:41:58.117654 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:41:58.117654 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:41:58.117654 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: 0235b8fe92554131ba30e1d18f0f2d86 Jul 20 15:41:58.117654 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:41:58.117654 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:41:58.117654 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance 34721a3c-bac8-4cea-9f1d-6ee067b62ade could not be found. Jul 20 15:41:58.117654 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': '34721a3c-bac8-4cea-9f1d-6ee067b62ade'} Jul 20 15:41:58.119092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:41:58.119092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:41:58.119092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:41:58.119092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:41:58.119092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:41:58.119092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:41:58.119092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:41:58.119092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:41:58.119092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:41:58.119092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:41:58.119092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34721a3c-bac8-4cea-9f1d-6ee067b62ade could not be found. Jul 20 15:41:58.119092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:41:58.119092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:41:58.119092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:41:58.119092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:41:58.119092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:41:58.119092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:41:58.119092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:41:58.119092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:41:58.119092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:41:58.122128 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:41:58.122128 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:41:58.122128 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:41:58.122128 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:41:58.122128 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:41:58.122128 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:41:58.122128 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:41:58.122128 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34721a3c-bac8-4cea-9f1d-6ee067b62ade could not be found. Jul 20 15:41:58.122128 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:41:58.122128 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:41:58.122128 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:41:58.122128 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:41:58.122128 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:41:58.122128 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:41:58.122128 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:41:58.122128 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:41:58.122128 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34721a3c-bac8-4cea-9f1d-6ee067b62ade could not be found. Jul 20 15:41:58.122128 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:41:58.124135 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-acb7cc4f-5dfa-44ab-b82a-be9f483d482e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Returning 404 to user: Instance 34721a3c-bac8-4cea-9f1d-6ee067b62ade could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:41:58.124135 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-acb7cc4f-5dfa-44ab-b82a-be9f483d482e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade" status: 404 len: 111 microversion: 2.1 time: 0.031550 Jul 20 15:41:58.124135 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 509/1014] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:41:58 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 15:41:58.129944 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-42f75880-925e-4746-857e-a87ca458503b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '.version_select at 0x7efd90974310>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:41:58.438016 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-42f75880-925e-4746-857e-a87ca458503b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1699995310" status: 202 len: 0 microversion: 2.1 time: 0.312078 Jul 20 15:41:58.438547 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 506/1015] 10.222.0.78 () {58 vars in 1220 bytes} [Wed Jul 20 15:41:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1699995310 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:41:59.537233 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-9b5ca4c7-07d9-4562-8209-7d18f72203fc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Action: 'create', calling method: .version_select at 0x7efd90a215e0>, body: {"keypair": {"name": "tempest-keypair-1774159353", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCS2YNAhfbDTN8O7bbAN9Meq99K0XmPp8llhsdHR0jnHR1+EZOj6DuRXH0XLWmO4yIvu2dyPfeYm/l/XNffVPg7ItvCwVs6LFXABtJpgI/MF36qS2EveoPtwgw28g6HO9w=="}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:41:59.559249 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-9b5ca4c7-07d9-4562-8209-7d18f72203fc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Getting quotas for project 44dc2a5c754d42d1862b331afef2183f. Resources: {'key_pairs'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:41:59.564246 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-9b5ca4c7-07d9-4562-8209-7d18f72203fc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Getting quotas for user 0235b8fe92554131ba30e1d18f0f2d86 and project 44dc2a5c754d42d1862b331afef2183f. Resources: {'key_pairs'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:41:59.667168 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-9b5ca4c7-07d9-4562-8209-7d18f72203fc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.133017 Jul 20 15:41:59.667686 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 510/1016] 10.222.0.78 () {60 vars in 1158 bytes} [Wed Jul 20 15:41:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:42:02.307498 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c19fa85a-6be8-40f7-984d-036ef5165e20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1168957855", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1520672230", "security_groups": [{"name": "tempest-secgroup-smoke-463581945"}], "block_device_mapping_v2": [{"uuid": "8627cabd-35d9-449e-afd8-f64dfa6d160c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8628016f-4714-4c11-b108-0d43d71372c8"}]}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:42:02.457411 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.network.neutron [None req-c19fa85a-6be8-40f7-984d-036ef5165e20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] validate_networks() for [('8628016f-4714-4c11-b108-0d43d71372c8', None, None, None, None, None)] {{(pid=124711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 15:42:03.033196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-c19fa85a-6be8-40f7-984d-036ef5165e20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Flavor limits 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 15:42:03.033196 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-c19fa85a-6be8-40f7-984d-036ef5165e20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Image limits 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 15:42:03.033424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-c19fa85a-6be8-40f7-984d-036ef5165e20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Flavor pref 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 15:42:03.033915 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-c19fa85a-6be8-40f7-984d-036ef5165e20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Image pref 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 15:42:03.034424 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-c19fa85a-6be8-40f7-984d-036ef5165e20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 15:42:03.045605 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c19fa85a-6be8-40f7-984d-036ef5165e20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:03.049151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c19fa85a-6be8-40f7-984d-036ef5165e20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:03.049151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c19fa85a-6be8-40f7-984d-036ef5165e20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:03.049151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c19fa85a-6be8-40f7-984d-036ef5165e20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:03.066458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-c19fa85a-6be8-40f7-984d-036ef5165e20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Getting quotas for project 68372ee91fb843108d3b0cb1c99cd186. Resources: {'instances', 'ram', 'cores'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:42:03.071171 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-c19fa85a-6be8-40f7-984d-036ef5165e20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Getting quotas for user cb4dc884b7eb4aa8a0adcdb46c5f9586 and project 68372ee91fb843108d3b0cb1c99cd186. Resources: {'instances', 'ram', 'cores'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:42:03.171036 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c19fa85a-6be8-40f7-984d-036ef5165e20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Going to run 1 instances... {{(pid=124711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 15:42:03.174245 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c19fa85a-6be8-40f7-984d-036ef5165e20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8627cabd-35d9-449e-afd8-f64dfa6d160c',volume_size=None,volume_type=None)] {{(pid=124711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 15:42:03.601485 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-ffe80337-9022-49f2-b83d-3cf8951edc87 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1729407875", "imageRef": "80914b1c-623c-42a8-810e-836b2cce0d3b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c0af21f-0efa-47e6-8a0b-19b7c3e7c8bc"}], "security_groups": [{"name": "tempest-securitygroup--898723971"}], "key_name": "tempest-keypair-1774159353", "user_data": "}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:42:03.728913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.network.neutron [None req-ffe80337-9022-49f2-b83d-3cf8951edc87 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] validate_networks() for [('4c0af21f-0efa-47e6-8a0b-19b7c3e7c8bc', None, None, None, None, None)] {{(pid=124712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 15:42:04.041013 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c19fa85a-6be8-40f7-984d-036ef5165e20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.737416 Jul 20 15:42:04.042481 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 507/1017] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Jul 20 15:42:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 15:42:04.052664 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-9bc8c598-9769-40f3-97f0-c7250db730ac tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:04.053282 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-9bc8c598-9769-40f3-97f0-c7250db730ac tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:04.164243 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-9bc8c598-9769-40f3-97f0-c7250db730ac tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:04.172218 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-9bc8c598-9769-40f3-97f0-c7250db730ac tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1095 microversion: 2.1 time: 0.123366 Jul 20 15:42:04.173400 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 508/1018] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:04 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1095 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:42:04.367424 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-ffe80337-9022-49f2-b83d-3cf8951edc87 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Flavor limits 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 15:42:04.368182 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-ffe80337-9022-49f2-b83d-3cf8951edc87 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Image limits 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 15:42:04.368741 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-ffe80337-9022-49f2-b83d-3cf8951edc87 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Flavor pref 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 15:42:04.369310 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-ffe80337-9022-49f2-b83d-3cf8951edc87 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Image pref 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 15:42:04.370673 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-ffe80337-9022-49f2-b83d-3cf8951edc87 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 15:42:04.382843 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ffe80337-9022-49f2-b83d-3cf8951edc87 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:04.383424 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ffe80337-9022-49f2-b83d-3cf8951edc87 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:04.384355 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ffe80337-9022-49f2-b83d-3cf8951edc87 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:04.385006 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-ffe80337-9022-49f2-b83d-3cf8951edc87 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:04.394761 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:04.407392 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-ffe80337-9022-49f2-b83d-3cf8951edc87 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Getting quotas for project 44dc2a5c754d42d1862b331afef2183f. Resources: {'instances', 'ram', 'cores'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:42:04.411647 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-ffe80337-9022-49f2-b83d-3cf8951edc87 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Getting quotas for user 0235b8fe92554131ba30e1d18f0f2d86 and project 44dc2a5c754d42d1862b331afef2183f. Resources: {'instances', 'ram', 'cores'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:42:04.423436 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-ffe80337-9022-49f2-b83d-3cf8951edc87 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Going to run 1 instances... {{(pid=124712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 15:42:04.425698 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-ffe80337-9022-49f2-b83d-3cf8951edc87 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80914b1c-623c-42a8-810e-836b2cce0d3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 15:42:04.875237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-ffe80337-9022-49f2-b83d-3cf8951edc87 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.278070 Jul 20 15:42:04.877823 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 511/1019] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Jul 20 15:42:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 1281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 15:42:04.887908 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-55d3bf40-12e5-4166-a1e6-580800cd59b5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:04.888525 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-55d3bf40-12e5-4166-a1e6-580800cd59b5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:04.993274 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-55d3bf40-12e5-4166-a1e6-580800cd59b5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:05.016927 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-55d3bf40-12e5-4166-a1e6-580800cd59b5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4" status: 200 len: 1242 microversion: 2.1 time: 0.118414 Jul 20 15:42:05.016927 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 509/1020] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:04 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 => generated 1242 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:05.192302 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-3bb173f0-d182-4bca-b83a-5c7d0b5038b3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:05.193293 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-3bb173f0-d182-4bca-b83a-5c7d0b5038b3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:05.251869 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-3bb173f0-d182-4bca-b83a-5c7d0b5038b3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:05.259648 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-3bb173f0-d182-4bca-b83a-5c7d0b5038b3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1095 microversion: 2.1 time: 0.071307 Jul 20 15:42:05.260237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 512/1021] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:05 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:06.037981 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-abb7761a-c4c0-443a-a8ae-dad670e56e29 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:06.038628 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-abb7761a-c4c0-443a-a8ae-dad670e56e29 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:06.041482 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:06.115284 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-abb7761a-c4c0-443a-a8ae-dad670e56e29 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:06.123165 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-abb7761a-c4c0-443a-a8ae-dad670e56e29 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4" status: 200 len: 1242 microversion: 2.1 time: 0.089653 Jul 20 15:42:06.124887 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 510/1022] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:06 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:06.278365 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-c4e9ff8b-b82f-43ec-ac89-b1af73e4c27d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:06.279661 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-c4e9ff8b-b82f-43ec-ac89-b1af73e4c27d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:06.288427 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c4e9ff8b-b82f-43ec-ac89-b1af73e4c27d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:06.292706 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c4e9ff8b-b82f-43ec-ac89-b1af73e4c27d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:06.292706 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c4e9ff8b-b82f-43ec-ac89-b1af73e4c27d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:06.292706 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c4e9ff8b-b82f-43ec-ac89-b1af73e4c27d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:06.383465 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-c4e9ff8b-b82f-43ec-ac89-b1af73e4c27d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:06.399516 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-c4e9ff8b-b82f-43ec-ac89-b1af73e4c27d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1145 microversion: 2.1 time: 0.126273 Jul 20 15:42:06.409891 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 513/1023] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:06 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1145 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:07.142046 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ab6bd60d-7a50-44bc-a06a-42a6d3447c92 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:07.142824 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ab6bd60d-7a50-44bc-a06a-42a6d3447c92 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:07.156723 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ab6bd60d-7a50-44bc-a06a-42a6d3447c92 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:07.157280 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ab6bd60d-7a50-44bc-a06a-42a6d3447c92 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:07.158958 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ab6bd60d-7a50-44bc-a06a-42a6d3447c92 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:07.159802 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ab6bd60d-7a50-44bc-a06a-42a6d3447c92 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:07.252998 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-ab6bd60d-7a50-44bc-a06a-42a6d3447c92 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:07.261096 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-ab6bd60d-7a50-44bc-a06a-42a6d3447c92 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4" status: 200 len: 1294 microversion: 2.1 time: 0.123720 Jul 20 15:42:07.276616 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 511/1024] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:07 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 => generated 1294 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:07.417709 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-c3ac4bbb-0329-4209-b75f-4d152578d325 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:07.418373 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-c3ac4bbb-0329-4209-b75f-4d152578d325 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:07.420753 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:07.425873 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c3ac4bbb-0329-4209-b75f-4d152578d325 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:07.426454 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c3ac4bbb-0329-4209-b75f-4d152578d325 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:07.427143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c3ac4bbb-0329-4209-b75f-4d152578d325 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:07.427576 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-c3ac4bbb-0329-4209-b75f-4d152578d325 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:07.520204 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-c3ac4bbb-0329-4209-b75f-4d152578d325 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:07.520204 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-c3ac4bbb-0329-4209-b75f-4d152578d325 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1193 microversion: 2.1 time: 0.098341 Jul 20 15:42:07.520204 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 514/1025] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:07 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1193 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:08.289491 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-11ec6d81-da1d-4fe7-a1c2-cea61a8189a8 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:08.290157 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-11ec6d81-da1d-4fe7-a1c2-cea61a8189a8 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:08.308548 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-11ec6d81-da1d-4fe7-a1c2-cea61a8189a8 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:08.318577 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-11ec6d81-da1d-4fe7-a1c2-cea61a8189a8 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:08.319884 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-11ec6d81-da1d-4fe7-a1c2-cea61a8189a8 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:08.320908 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-11ec6d81-da1d-4fe7-a1c2-cea61a8189a8 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:08.452322 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-11ec6d81-da1d-4fe7-a1c2-cea61a8189a8 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:08.472304 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-11ec6d81-da1d-4fe7-a1c2-cea61a8189a8 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4" status: 200 len: 1312 microversion: 2.1 time: 0.189776 Jul 20 15:42:08.472889 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 512/1026] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:08 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 => generated 1312 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:08.529440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b9641de8-7159-49a8-9bdc-9a18c4c92992 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:08.530053 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b9641de8-7159-49a8-9bdc-9a18c4c92992 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:08.539840 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b9641de8-7159-49a8-9bdc-9a18c4c92992 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:08.540671 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b9641de8-7159-49a8-9bdc-9a18c4c92992 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:08.543062 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b9641de8-7159-49a8-9bdc-9a18c4c92992 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:08.543979 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b9641de8-7159-49a8-9bdc-9a18c4c92992 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:08.640998 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b9641de8-7159-49a8-9bdc-9a18c4c92992 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:08.652016 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b9641de8-7159-49a8-9bdc-9a18c4c92992 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1211 microversion: 2.1 time: 0.126720 Jul 20 15:42:08.654587 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 515/1027] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:08 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1211 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:09.490087 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-298965e3-4ba0-4939-8793-7bfbd06b0bdb tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:09.491534 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-298965e3-4ba0-4939-8793-7bfbd06b0bdb tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:09.499287 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-298965e3-4ba0-4939-8793-7bfbd06b0bdb tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:09.505425 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-298965e3-4ba0-4939-8793-7bfbd06b0bdb tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:09.505425 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-298965e3-4ba0-4939-8793-7bfbd06b0bdb tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:09.505425 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-298965e3-4ba0-4939-8793-7bfbd06b0bdb tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:09.567560 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-298965e3-4ba0-4939-8793-7bfbd06b0bdb tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:09.575725 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-298965e3-4ba0-4939-8793-7bfbd06b0bdb tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4" status: 200 len: 1300 microversion: 2.1 time: 0.090038 Jul 20 15:42:09.588296 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 513/1028] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:09 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:09.672382 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-5d15c4ff-7065-45f1-9087-882e031e8da6 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:09.676454 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-5d15c4ff-7065-45f1-9087-882e031e8da6 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:09.684289 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5d15c4ff-7065-45f1-9087-882e031e8da6 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:09.684855 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5d15c4ff-7065-45f1-9087-882e031e8da6 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:09.685793 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5d15c4ff-7065-45f1-9087-882e031e8da6 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:09.686425 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-5d15c4ff-7065-45f1-9087-882e031e8da6 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:09.829798 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-5d15c4ff-7065-45f1-9087-882e031e8da6 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:09.837627 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-5d15c4ff-7065-45f1-9087-882e031e8da6 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1278 microversion: 2.1 time: 0.169236 Jul 20 15:42:09.838311 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 516/1029] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:09 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1278 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:10.593111 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-f877175f-0a2d-4800-9741-48776fb7596e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:10.593703 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-f877175f-0a2d-4800-9741-48776fb7596e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:10.600071 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f877175f-0a2d-4800-9741-48776fb7596e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:10.600512 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f877175f-0a2d-4800-9741-48776fb7596e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:10.601260 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f877175f-0a2d-4800-9741-48776fb7596e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:10.601685 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f877175f-0a2d-4800-9741-48776fb7596e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:10.763271 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-f877175f-0a2d-4800-9741-48776fb7596e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:10.771960 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-f877175f-0a2d-4800-9741-48776fb7596e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4" status: 200 len: 1367 microversion: 2.1 time: 0.182550 Jul 20 15:42:10.772619 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 514/1030] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:10 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:10.864242 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-1ca66d49-972e-4548-9fe0-e80a896b8556 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:10.864242 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-1ca66d49-972e-4548-9fe0-e80a896b8556 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:10.867483 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1ca66d49-972e-4548-9fe0-e80a896b8556 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:10.867934 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1ca66d49-972e-4548-9fe0-e80a896b8556 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:10.868716 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1ca66d49-972e-4548-9fe0-e80a896b8556 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:10.869150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1ca66d49-972e-4548-9fe0-e80a896b8556 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:11.045704 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-1ca66d49-972e-4548-9fe0-e80a896b8556 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:11.058704 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-1ca66d49-972e-4548-9fe0-e80a896b8556 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1266 microversion: 2.1 time: 0.205468 Jul 20 15:42:11.059302 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 517/1031] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:10 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:42:11.180926 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-6d2df45e-ec5b-47b5-b02a-018e64b44914 req-bbc3286d-b8c1-43a9-988b-7f4378950957 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dd5710a-4106-4dcd-8ec4-083d49813b41", "tag": "9062b142-2a3f-4a67-a60e-b3ba58fb3834"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:42:11.196254 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-6d2df45e-ec5b-47b5-b02a-018e64b44914 req-bbc3286d-b8c1-43a9-988b-7f4378950957 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:11.196254 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-6d2df45e-ec5b-47b5-b02a-018e64b44914 req-bbc3286d-b8c1-43a9-988b-7f4378950957 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:11.214137 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-6d2df45e-ec5b-47b5-b02a-018e64b44914 req-bbc3286d-b8c1-43a9-988b-7f4378950957 service nova] Creating event network-changed:9062b142-2a3f-4a67-a60e-b3ba58fb3834 for instance 8dd5710a-4106-4dcd-8ec4-083d49813b41 on hv-cinder-81914 Jul 20 15:42:11.225972 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-6d2df45e-ec5b-47b5-b02a-018e64b44914 req-bbc3286d-b8c1-43a9-988b-7f4378950957 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048657 Jul 20 15:42:11.226671 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 515/1032] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:42:11.788310 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-23b4b8f5-0925-45ad-a88b-0436610193f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:11.789023 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-23b4b8f5-0925-45ad-a88b-0436610193f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:11.795906 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-23b4b8f5-0925-45ad-a88b-0436610193f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:11.796355 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-23b4b8f5-0925-45ad-a88b-0436610193f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:11.797120 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-23b4b8f5-0925-45ad-a88b-0436610193f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:11.797587 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-23b4b8f5-0925-45ad-a88b-0436610193f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:11.935208 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-23b4b8f5-0925-45ad-a88b-0436610193f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:11.943273 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-23b4b8f5-0925-45ad-a88b-0436610193f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4" status: 200 len: 1367 microversion: 2.1 time: 0.158829 Jul 20 15:42:11.944119 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 518/1033] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:11 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:12.083998 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-38093f60-0012-4889-b948-8fe4a07163b4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:12.084923 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-38093f60-0012-4889-b948-8fe4a07163b4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:12.091014 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-38093f60-0012-4889-b948-8fe4a07163b4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:12.091455 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-38093f60-0012-4889-b948-8fe4a07163b4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:12.092234 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-38093f60-0012-4889-b948-8fe4a07163b4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:12.092729 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-38093f60-0012-4889-b948-8fe4a07163b4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:12.234647 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-38093f60-0012-4889-b948-8fe4a07163b4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:12.242159 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-38093f60-0012-4889-b948-8fe4a07163b4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1266 microversion: 2.1 time: 0.163046 Jul 20 15:42:12.247755 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 516/1034] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:12 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:12.961340 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-993c3e2c-b572-4691-b900-02d74cab7599 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:12.962418 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-993c3e2c-b572-4691-b900-02d74cab7599 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:12.969775 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-993c3e2c-b572-4691-b900-02d74cab7599 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:12.970589 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-993c3e2c-b572-4691-b900-02d74cab7599 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:12.971377 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-993c3e2c-b572-4691-b900-02d74cab7599 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:12.973452 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-993c3e2c-b572-4691-b900-02d74cab7599 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:13.108359 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-993c3e2c-b572-4691-b900-02d74cab7599 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:13.116021 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-993c3e2c-b572-4691-b900-02d74cab7599 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4" status: 200 len: 1367 microversion: 2.1 time: 0.158848 Jul 20 15:42:13.116550 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 519/1035] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:12 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:13.241653 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-61af6473-a31a-480c-a966-b6a01493420e req-0efcd04b-fd8d-43c4-bb97-305ff2cf0377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "023a1736-7558-4434-9b4d-4bbe0d9f4ea4", "tag": "38c141c8-0909-4ef8-8ff6-6a25e3d25531"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:42:13.245326 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=2 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:13.251371 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-61af6473-a31a-480c-a966-b6a01493420e req-0efcd04b-fd8d-43c4-bb97-305ff2cf0377 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:13.251818 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-61af6473-a31a-480c-a966-b6a01493420e req-0efcd04b-fd8d-43c4-bb97-305ff2cf0377 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:13.260616 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-35237c3c-1814-469e-9649-be6b497f22e4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:13.261438 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-35237c3c-1814-469e-9649-be6b497f22e4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:13.264630 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-61af6473-a31a-480c-a966-b6a01493420e req-0efcd04b-fd8d-43c4-bb97-305ff2cf0377 service nova] Creating event network-changed:38c141c8-0909-4ef8-8ff6-6a25e3d25531 for instance 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 on hv-cinder-81914 Jul 20 15:42:13.268316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-35237c3c-1814-469e-9649-be6b497f22e4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:13.268965 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-35237c3c-1814-469e-9649-be6b497f22e4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:13.269766 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-35237c3c-1814-469e-9649-be6b497f22e4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:13.270492 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-35237c3c-1814-469e-9649-be6b497f22e4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:13.270723 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-61af6473-a31a-480c-a966-b6a01493420e req-0efcd04b-fd8d-43c4-bb97-305ff2cf0377 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032482 Jul 20 15:42:13.272242 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 517/1036] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:42:13.415277 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-35237c3c-1814-469e-9649-be6b497f22e4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:13.422792 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-35237c3c-1814-469e-9649-be6b497f22e4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1266 microversion: 2.1 time: 0.167008 Jul 20 15:42:13.423361 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 520/1037] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:13 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:42:14.134340 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-9a575ff3-a5ae-4a9a-b843-bbf66d818418 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:14.135050 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-9a575ff3-a5ae-4a9a-b843-bbf66d818418 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:14.142954 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9a575ff3-a5ae-4a9a-b843-bbf66d818418 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:14.149524 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9a575ff3-a5ae-4a9a-b843-bbf66d818418 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:14.149524 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9a575ff3-a5ae-4a9a-b843-bbf66d818418 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:14.149524 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9a575ff3-a5ae-4a9a-b843-bbf66d818418 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:14.305586 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-9a575ff3-a5ae-4a9a-b843-bbf66d818418 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:14.315725 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-9a575ff3-a5ae-4a9a-b843-bbf66d818418 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4" status: 200 len: 1367 microversion: 2.1 time: 0.185927 Jul 20 15:42:14.325238 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 518/1038] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:14 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:14.441693 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-1beb4672-7fb2-4644-955b-37da8d1d8fce tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:14.442948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-1beb4672-7fb2-4644-955b-37da8d1d8fce tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:14.446782 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=2 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:14.452779 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1beb4672-7fb2-4644-955b-37da8d1d8fce tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:14.453469 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1beb4672-7fb2-4644-955b-37da8d1d8fce tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:14.454253 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1beb4672-7fb2-4644-955b-37da8d1d8fce tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:14.454717 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1beb4672-7fb2-4644-955b-37da8d1d8fce tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:14.613446 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-1beb4672-7fb2-4644-955b-37da8d1d8fce tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:14.616245 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-1beb4672-7fb2-4644-955b-37da8d1d8fce tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1266 microversion: 2.1 time: 0.180111 Jul 20 15:42:14.616838 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 521/1039] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:14 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:15.334064 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-24c0c41c-1c72-48d1-8877-1b021838a208 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:15.334662 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-24c0c41c-1c72-48d1-8877-1b021838a208 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:15.340846 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-24c0c41c-1c72-48d1-8877-1b021838a208 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:15.341354 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-24c0c41c-1c72-48d1-8877-1b021838a208 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:15.348377 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-24c0c41c-1c72-48d1-8877-1b021838a208 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:15.348377 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-24c0c41c-1c72-48d1-8877-1b021838a208 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:15.485007 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-24c0c41c-1c72-48d1-8877-1b021838a208 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:15.492644 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-24c0c41c-1c72-48d1-8877-1b021838a208 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4" status: 200 len: 1367 microversion: 2.1 time: 0.162958 Jul 20 15:42:15.493212 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 519/1040] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:15 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:15.633238 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-a67ca423-cf50-4208-bd7d-ec194a883a3a tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:15.633944 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-a67ca423-cf50-4208-bd7d-ec194a883a3a tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:15.635773 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=12 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:15.641716 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a67ca423-cf50-4208-bd7d-ec194a883a3a tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:15.641858 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a67ca423-cf50-4208-bd7d-ec194a883a3a tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:15.642613 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a67ca423-cf50-4208-bd7d-ec194a883a3a tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:15.643045 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a67ca423-cf50-4208-bd7d-ec194a883a3a tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:15.823030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-a67ca423-cf50-4208-bd7d-ec194a883a3a tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:15.823030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-a67ca423-cf50-4208-bd7d-ec194a883a3a tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1266 microversion: 2.1 time: 0.185431 Jul 20 15:42:15.823030 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 522/1041] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:15 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:16.511538 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-ab14e0d9-d6c0-46d1-b75c-6df31320c11d tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:16.512506 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-ab14e0d9-d6c0-46d1-b75c-6df31320c11d tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:16.516086 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=12 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:16.521160 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ab14e0d9-d6c0-46d1-b75c-6df31320c11d tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:16.521611 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ab14e0d9-d6c0-46d1-b75c-6df31320c11d tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:16.522429 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ab14e0d9-d6c0-46d1-b75c-6df31320c11d tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:16.522865 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-ab14e0d9-d6c0-46d1-b75c-6df31320c11d tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:16.622868 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-3690d69d-6daa-4de2-a376-c994e30f6976 req-7f7487f7-9c8a-434d-87bf-c5b0a949d3df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023a1736-7558-4434-9b4d-4bbe0d9f4ea4", "name": "network-vif-plugged", "status": "completed", "tag": "38c141c8-0909-4ef8-8ff6-6a25e3d25531"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:42:16.630405 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-3690d69d-6daa-4de2-a376-c994e30f6976 req-7f7487f7-9c8a-434d-87bf-c5b0a949d3df service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:16.630917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-3690d69d-6daa-4de2-a376-c994e30f6976 req-7f7487f7-9c8a-434d-87bf-c5b0a949d3df service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:16.646072 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-3690d69d-6daa-4de2-a376-c994e30f6976 req-7f7487f7-9c8a-434d-87bf-c5b0a949d3df service nova] Creating event network-vif-plugged:38c141c8-0909-4ef8-8ff6-6a25e3d25531 for instance 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 on hv-cinder-81914 Jul 20 15:42:16.651515 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-3690d69d-6daa-4de2-a376-c994e30f6976 req-7f7487f7-9c8a-434d-87bf-c5b0a949d3df service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034774 Jul 20 15:42:16.652303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 523/1042] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:42:16.667506 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-ab14e0d9-d6c0-46d1-b75c-6df31320c11d tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:16.676385 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-ab14e0d9-d6c0-46d1-b75c-6df31320c11d tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4" status: 200 len: 1367 microversion: 2.1 time: 0.169483 Jul 20 15:42:16.676976 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 520/1043] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:16 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:16.834404 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-70ffac51-8251-4f78-95d2-bf42d3514faa tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:16.838314 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-70ffac51-8251-4f78-95d2-bf42d3514faa tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:16.846654 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-70ffac51-8251-4f78-95d2-bf42d3514faa tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:16.847104 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-70ffac51-8251-4f78-95d2-bf42d3514faa tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:16.847899 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-70ffac51-8251-4f78-95d2-bf42d3514faa tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:16.848432 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-70ffac51-8251-4f78-95d2-bf42d3514faa tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:17.017678 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-70ffac51-8251-4f78-95d2-bf42d3514faa tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:17.026725 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-70ffac51-8251-4f78-95d2-bf42d3514faa tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1266 microversion: 2.1 time: 0.196260 Jul 20 15:42:17.027250 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 524/1044] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:16 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:42:17.693248 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-bb0751b4-86ca-4d9f-ab74-9a1f970b04b1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:17.693970 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-bb0751b4-86ca-4d9f-ab74-9a1f970b04b1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:17.701247 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bb0751b4-86ca-4d9f-ab74-9a1f970b04b1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:17.701695 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bb0751b4-86ca-4d9f-ab74-9a1f970b04b1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:17.702511 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bb0751b4-86ca-4d9f-ab74-9a1f970b04b1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:17.702951 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bb0751b4-86ca-4d9f-ab74-9a1f970b04b1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:17.847123 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-bb0751b4-86ca-4d9f-ab74-9a1f970b04b1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:17.854601 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-bb0751b4-86ca-4d9f-ab74-9a1f970b04b1 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4" status: 200 len: 1367 microversion: 2.1 time: 0.165446 Jul 20 15:42:17.855164 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 521/1045] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:17 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:18.047137 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-191cedd2-f954-475b-b892-6f9982dff219 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:18.047832 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-191cedd2-f954-475b-b892-6f9982dff219 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:18.055797 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-191cedd2-f954-475b-b892-6f9982dff219 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:18.056252 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-191cedd2-f954-475b-b892-6f9982dff219 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:18.057503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-191cedd2-f954-475b-b892-6f9982dff219 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:18.057935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-191cedd2-f954-475b-b892-6f9982dff219 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:18.205975 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-191cedd2-f954-475b-b892-6f9982dff219 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:18.213550 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-191cedd2-f954-475b-b892-6f9982dff219 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1266 microversion: 2.1 time: 0.170267 Jul 20 15:42:18.216376 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 525/1046] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:18 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:18.872058 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-3867d2a3-2ea0-4f3c-aefd-cae18ab511d3 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:18.872719 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-3867d2a3-2ea0-4f3c-aefd-cae18ab511d3 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:18.879619 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3867d2a3-2ea0-4f3c-aefd-cae18ab511d3 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:18.880061 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3867d2a3-2ea0-4f3c-aefd-cae18ab511d3 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:18.880858 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3867d2a3-2ea0-4f3c-aefd-cae18ab511d3 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:18.881309 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3867d2a3-2ea0-4f3c-aefd-cae18ab511d3 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:19.012159 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-3867d2a3-2ea0-4f3c-aefd-cae18ab511d3 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:19.019981 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-3867d2a3-2ea0-4f3c-aefd-cae18ab511d3 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4" status: 200 len: 1556 microversion: 2.1 time: 0.152388 Jul 20 15:42:19.020536 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 522/1047] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:18 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:19.044568 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-f792edfe-1622-4d0c-a91d-410c4bb861a8 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:19.045060 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-f792edfe-1622-4d0c-a91d-410c4bb861a8 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:19.051471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f792edfe-1622-4d0c-a91d-410c4bb861a8 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:19.052073 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f792edfe-1622-4d0c-a91d-410c4bb861a8 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:19.052662 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f792edfe-1622-4d0c-a91d-410c4bb861a8 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:19.053094 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f792edfe-1622-4d0c-a91d-410c4bb861a8 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:19.135296 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-f792edfe-1622-4d0c-a91d-410c4bb861a8 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094684 Jul 20 15:42:19.135902 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 526/1048] 10.222.0.78 () {58 vars in 1274 bytes} [Wed Jul 20 15:42:19 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:42:19.230573 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-0639a0ec-cea5-4a99-ab4d-fe2963cc32e5 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:19.231182 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-0639a0ec-cea5-4a99-ab4d-fe2963cc32e5 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:19.238822 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0639a0ec-cea5-4a99-ab4d-fe2963cc32e5 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:19.239300 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0639a0ec-cea5-4a99-ab4d-fe2963cc32e5 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:19.240065 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0639a0ec-cea5-4a99-ab4d-fe2963cc32e5 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:19.240494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-0639a0ec-cea5-4a99-ab4d-fe2963cc32e5 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:19.392423 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-0639a0ec-cea5-4a99-ab4d-fe2963cc32e5 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:19.400177 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-0639a0ec-cea5-4a99-ab4d-fe2963cc32e5 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1266 microversion: 2.1 time: 0.173778 Jul 20 15:42:19.401326 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 523/1049] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:19 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:20.209917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-2fb9507d-25ed-4d75-a6b9-93f9ca637452 req-740018fb-8fe1-46aa-85b4-c496eb7a85d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "023a1736-7558-4434-9b4d-4bbe0d9f4ea4", "tag": "38c141c8-0909-4ef8-8ff6-6a25e3d25531"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:42:20.219208 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-2fb9507d-25ed-4d75-a6b9-93f9ca637452 req-740018fb-8fe1-46aa-85b4-c496eb7a85d8 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:20.219748 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-2fb9507d-25ed-4d75-a6b9-93f9ca637452 req-740018fb-8fe1-46aa-85b4-c496eb7a85d8 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:20.231907 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-2fb9507d-25ed-4d75-a6b9-93f9ca637452 req-740018fb-8fe1-46aa-85b4-c496eb7a85d8 service nova] Creating event network-changed:38c141c8-0909-4ef8-8ff6-6a25e3d25531 for instance 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 on hv-cinder-81914 Jul 20 15:42:20.236721 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-2fb9507d-25ed-4d75-a6b9-93f9ca637452 req-740018fb-8fe1-46aa-85b4-c496eb7a85d8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031048 Jul 20 15:42:20.237328 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 527/1050] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:42:20.418205 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-cd0ce47a-52a2-4cbf-89e1-678a3fbd86ab tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:20.419094 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-cd0ce47a-52a2-4cbf-89e1-678a3fbd86ab tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:20.428760 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cd0ce47a-52a2-4cbf-89e1-678a3fbd86ab tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:20.429749 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cd0ce47a-52a2-4cbf-89e1-678a3fbd86ab tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:20.432073 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cd0ce47a-52a2-4cbf-89e1-678a3fbd86ab tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:20.433098 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cd0ce47a-52a2-4cbf-89e1-678a3fbd86ab tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:20.613709 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-cd0ce47a-52a2-4cbf-89e1-678a3fbd86ab tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:20.622162 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-cd0ce47a-52a2-4cbf-89e1-678a3fbd86ab tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1266 microversion: 2.1 time: 0.208721 Jul 20 15:42:20.622765 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 524/1051] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:20 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:21.640836 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d18fadc5-c4a4-446e-a05b-16dd7ac6af37 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:21.641539 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d18fadc5-c4a4-446e-a05b-16dd7ac6af37 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:21.648113 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d18fadc5-c4a4-446e-a05b-16dd7ac6af37 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:21.648568 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d18fadc5-c4a4-446e-a05b-16dd7ac6af37 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:21.649344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d18fadc5-c4a4-446e-a05b-16dd7ac6af37 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:21.649786 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d18fadc5-c4a4-446e-a05b-16dd7ac6af37 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:21.793556 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d18fadc5-c4a4-446e-a05b-16dd7ac6af37 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:21.800554 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-d18fadc5-c4a4-446e-a05b-16dd7ac6af37 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1266 microversion: 2.1 time: 0.164206 Jul 20 15:42:21.804760 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 528/1052] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:21 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:22.819055 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c706e4df-02e6-4207-b372-742d08ee0a38 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:22.819742 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c706e4df-02e6-4207-b372-742d08ee0a38 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:22.826951 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c706e4df-02e6-4207-b372-742d08ee0a38 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:22.827407 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c706e4df-02e6-4207-b372-742d08ee0a38 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:22.828264 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c706e4df-02e6-4207-b372-742d08ee0a38 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:22.828702 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c706e4df-02e6-4207-b372-742d08ee0a38 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:22.969230 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c706e4df-02e6-4207-b372-742d08ee0a38 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:22.977981 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c706e4df-02e6-4207-b372-742d08ee0a38 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1266 microversion: 2.1 time: 0.162885 Jul 20 15:42:22.978687 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 525/1053] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:22 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:42:23.995706 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-fe54e0a5-bacc-481e-904f-6618e49f77b7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:23.996247 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-fe54e0a5-bacc-481e-904f-6618e49f77b7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:24.002860 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fe54e0a5-bacc-481e-904f-6618e49f77b7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:24.003305 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fe54e0a5-bacc-481e-904f-6618e49f77b7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:24.004060 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fe54e0a5-bacc-481e-904f-6618e49f77b7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:24.004495 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-fe54e0a5-bacc-481e-904f-6618e49f77b7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:24.140054 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-fe54e0a5-bacc-481e-904f-6618e49f77b7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:24.147527 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-fe54e0a5-bacc-481e-904f-6618e49f77b7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1266 microversion: 2.1 time: 0.156301 Jul 20 15:42:24.148090 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 529/1054] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:23 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:25.164639 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-128b0ac3-7b9c-439a-afd1-7d17958077aa tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:25.165259 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-128b0ac3-7b9c-439a-afd1-7d17958077aa tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:25.171904 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-128b0ac3-7b9c-439a-afd1-7d17958077aa tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:25.172346 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-128b0ac3-7b9c-439a-afd1-7d17958077aa tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:25.173101 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-128b0ac3-7b9c-439a-afd1-7d17958077aa tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:25.173531 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-128b0ac3-7b9c-439a-afd1-7d17958077aa tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:25.310289 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-128b0ac3-7b9c-439a-afd1-7d17958077aa tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:25.318349 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-128b0ac3-7b9c-439a-afd1-7d17958077aa tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1266 microversion: 2.1 time: 0.157576 Jul 20 15:42:25.318910 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 526/1055] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:25 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:26.336924 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-61d9aba9-a356-4173-86f2-de3a2d84fac0 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:26.338699 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-61d9aba9-a356-4173-86f2-de3a2d84fac0 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:26.345367 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-61d9aba9-a356-4173-86f2-de3a2d84fac0 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:26.345822 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-61d9aba9-a356-4173-86f2-de3a2d84fac0 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:26.346613 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-61d9aba9-a356-4173-86f2-de3a2d84fac0 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:26.347052 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-61d9aba9-a356-4173-86f2-de3a2d84fac0 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:26.385028 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-04603c29-1918-4c7a-a7e5-4fb55e2decd7 req-9eed4568-05a4-4835-a6ad-32f8c77fb128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd5710a-4106-4dcd-8ec4-083d49813b41", "name": "network-vif-plugged", "status": "completed", "tag": "9062b142-2a3f-4a67-a60e-b3ba58fb3834"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:42:26.394822 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-04603c29-1918-4c7a-a7e5-4fb55e2decd7 req-9eed4568-05a4-4835-a6ad-32f8c77fb128 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:26.398233 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-04603c29-1918-4c7a-a7e5-4fb55e2decd7 req-9eed4568-05a4-4835-a6ad-32f8c77fb128 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:26.408129 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-04603c29-1918-4c7a-a7e5-4fb55e2decd7 req-9eed4568-05a4-4835-a6ad-32f8c77fb128 service nova] Creating event network-vif-plugged:9062b142-2a3f-4a67-a60e-b3ba58fb3834 for instance 8dd5710a-4106-4dcd-8ec4-083d49813b41 on hv-cinder-81914 Jul 20 15:42:26.414062 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-04603c29-1918-4c7a-a7e5-4fb55e2decd7 req-9eed4568-05a4-4835-a6ad-32f8c77fb128 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032713 Jul 20 15:42:26.414711 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 527/1056] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:42:26.490095 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-61d9aba9-a356-4173-86f2-de3a2d84fac0 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:26.497512 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-61d9aba9-a356-4173-86f2-de3a2d84fac0 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1266 microversion: 2.1 time: 0.165324 Jul 20 15:42:26.498089 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 530/1057] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:26 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:27.514904 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-cb204d57-95a0-4cb7-9af5-0f3d89bcd9f3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:27.515601 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-cb204d57-95a0-4cb7-9af5-0f3d89bcd9f3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:27.522221 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cb204d57-95a0-4cb7-9af5-0f3d89bcd9f3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:27.522709 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cb204d57-95a0-4cb7-9af5-0f3d89bcd9f3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:27.523627 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cb204d57-95a0-4cb7-9af5-0f3d89bcd9f3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:27.524068 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-cb204d57-95a0-4cb7-9af5-0f3d89bcd9f3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:27.657761 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-cb204d57-95a0-4cb7-9af5-0f3d89bcd9f3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:27.667510 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-cb204d57-95a0-4cb7-9af5-0f3d89bcd9f3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1266 microversion: 2.1 time: 0.157745 Jul 20 15:42:27.668083 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 528/1058] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:27 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:28.684935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-2e016727-5e81-4ce8-ade6-c4d1ef1f3c37 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:28.685552 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-2e016727-5e81-4ce8-ade6-c4d1ef1f3c37 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:28.691746 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2e016727-5e81-4ce8-ade6-c4d1ef1f3c37 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:28.692196 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2e016727-5e81-4ce8-ade6-c4d1ef1f3c37 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:28.692944 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2e016727-5e81-4ce8-ade6-c4d1ef1f3c37 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:28.693533 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2e016727-5e81-4ce8-ade6-c4d1ef1f3c37 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:28.696204 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=100 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:28.829331 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-2e016727-5e81-4ce8-ade6-c4d1ef1f3c37 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:28.837147 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-2e016727-5e81-4ce8-ade6-c4d1ef1f3c37 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1266 microversion: 2.1 time: 0.156735 Jul 20 15:42:28.837741 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 531/1059] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:28 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:29.853125 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-321ec7a2-9d3a-4d43-9770-112d404af752 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:29.853734 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-321ec7a2-9d3a-4d43-9770-112d404af752 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:29.860526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-321ec7a2-9d3a-4d43-9770-112d404af752 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:29.863597 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-321ec7a2-9d3a-4d43-9770-112d404af752 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:29.863597 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-321ec7a2-9d3a-4d43-9770-112d404af752 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:29.863597 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-321ec7a2-9d3a-4d43-9770-112d404af752 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:29.864947 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=100 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:30.004017 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-321ec7a2-9d3a-4d43-9770-112d404af752 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:30.012562 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-321ec7a2-9d3a-4d43-9770-112d404af752 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1266 microversion: 2.1 time: 0.163316 Jul 20 15:42:30.013127 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 529/1060] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:29 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:31.029408 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-63badc85-19fc-41cc-ba44-2f9aa8b95589 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:31.030072 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-63badc85-19fc-41cc-ba44-2f9aa8b95589 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:31.036839 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-63badc85-19fc-41cc-ba44-2f9aa8b95589 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:31.037298 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-63badc85-19fc-41cc-ba44-2f9aa8b95589 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:31.038100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-63badc85-19fc-41cc-ba44-2f9aa8b95589 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:31.038589 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-63badc85-19fc-41cc-ba44-2f9aa8b95589 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:31.178119 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-63badc85-19fc-41cc-ba44-2f9aa8b95589 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:31.186490 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-63badc85-19fc-41cc-ba44-2f9aa8b95589 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1266 microversion: 2.1 time: 0.161063 Jul 20 15:42:31.187349 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 532/1061] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:31 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:32.203810 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-38d18dd5-f102-455c-98dc-5e4b2ef35585 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:32.204401 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-38d18dd5-f102-455c-98dc-5e4b2ef35585 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:32.210972 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-38d18dd5-f102-455c-98dc-5e4b2ef35585 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:32.211312 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-38d18dd5-f102-455c-98dc-5e4b2ef35585 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:32.212062 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-38d18dd5-f102-455c-98dc-5e4b2ef35585 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:32.213003 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-38d18dd5-f102-455c-98dc-5e4b2ef35585 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:32.342294 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-38d18dd5-f102-455c-98dc-5e4b2ef35585 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:32.349800 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-38d18dd5-f102-455c-98dc-5e4b2ef35585 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1454 microversion: 2.1 time: 0.150160 Jul 20 15:42:32.350409 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 530/1062] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:32 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:32.365989 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-6b48059e-b0dc-4dbd-913a-886e3a4815ea tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:32.366623 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-6b48059e-b0dc-4dbd-913a-886e3a4815ea tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:32.372993 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6b48059e-b0dc-4dbd-913a-886e3a4815ea tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:32.373440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6b48059e-b0dc-4dbd-913a-886e3a4815ea tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:32.374192 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6b48059e-b0dc-4dbd-913a-886e3a4815ea tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:32.374667 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-6b48059e-b0dc-4dbd-913a-886e3a4815ea tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:32.507484 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-6b48059e-b0dc-4dbd-913a-886e3a4815ea tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:42:32.515260 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-6b48059e-b0dc-4dbd-913a-886e3a4815ea tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1454 microversion: 2.1 time: 0.153067 Jul 20 15:42:32.515835 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 533/1063] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:42:32 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:42:35.316286 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-0d597f53-0e64-4075-a4e0-369d837e4a46 req-91ad614c-fd9f-4987-ba9c-4d3a635ee8ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dd5710a-4106-4dcd-8ec4-083d49813b41", "tag": "9062b142-2a3f-4a67-a60e-b3ba58fb3834"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:42:35.324879 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-0d597f53-0e64-4075-a4e0-369d837e4a46 req-91ad614c-fd9f-4987-ba9c-4d3a635ee8ce service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:35.325566 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-0d597f53-0e64-4075-a4e0-369d837e4a46 req-91ad614c-fd9f-4987-ba9c-4d3a635ee8ce service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:35.337785 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-0d597f53-0e64-4075-a4e0-369d837e4a46 req-91ad614c-fd9f-4987-ba9c-4d3a635ee8ce service nova] Creating event network-changed:9062b142-2a3f-4a67-a60e-b3ba58fb3834 for instance 8dd5710a-4106-4dcd-8ec4-083d49813b41 on hv-cinder-81914 Jul 20 15:42:35.343227 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-0d597f53-0e64-4075-a4e0-369d837e4a46 req-91ad614c-fd9f-4987-ba9c-4d3a635ee8ce service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157671 Jul 20 15:42:35.344258 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 531/1064] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:42:56.559113 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-22bc9106-d83d-4a71-a76a-3b8cc8af44a8 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:42:56.559757 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-22bc9106-d83d-4a71-a76a-3b8cc8af44a8 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:56.562205 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=39 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:56.562917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=17 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:56.567847 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-22bc9106-d83d-4a71-a76a-3b8cc8af44a8 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:56.572768 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-22bc9106-d83d-4a71-a76a-3b8cc8af44a8 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:56.572768 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-22bc9106-d83d-4a71-a76a-3b8cc8af44a8 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:56.572768 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-22bc9106-d83d-4a71-a76a-3b8cc8af44a8 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:56.596082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-22bc9106-d83d-4a71-a76a-3b8cc8af44a8 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4/ips" status: 200 len: 149 microversion: 2.1 time: 0.040969 Jul 20 15:42:56.596720 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 534/1065] 10.222.0.78 () {58 vars in 1247 bytes} [Wed Jul 20 15:42:56 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:42:58.453168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-dafe5ef0-6888-4878-b1e3-eb9b7c7a32c4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c94f1c2a-19aa-4f76-b82a-a79dede82279"}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:42:58.454389 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-dafe5ef0-6888-4878-b1e3-eb9b7c7a32c4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:42:58.456750 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=45 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:58.457447 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=13 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:42:58.462835 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dafe5ef0-6888-4878-b1e3-eb9b7c7a32c4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:58.463311 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dafe5ef0-6888-4878-b1e3-eb9b7c7a32c4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:58.464137 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dafe5ef0-6888-4878-b1e3-eb9b7c7a32c4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:42:58.464571 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dafe5ef0-6888-4878-b1e3-eb9b7c7a32c4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:42:59.525088 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-dafe5ef0-6888-4878-b1e3-eb9b7c7a32c4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "POST /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.077208 Jul 20 15:42:59.526295 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 532/1066] 10.222.0.78 () {60 vars in 1322 bytes} [Wed Jul 20 15:42:58 2022] POST /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4/os-volume_attachments => generated 194 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:43:07.325062 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-2eeff5b4-b78e-41d6-b095-12b396eae4a0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:07.325625 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-2eeff5b4-b78e-41d6-b095-12b396eae4a0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:07.332510 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2eeff5b4-b78e-41d6-b095-12b396eae4a0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:07.332954 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2eeff5b4-b78e-41d6-b095-12b396eae4a0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:07.333708 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2eeff5b4-b78e-41d6-b095-12b396eae4a0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:07.334145 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-2eeff5b4-b78e-41d6-b095-12b396eae4a0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:07.413916 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.objects.instance [None req-2eeff5b4-b78e-41d6-b095-12b396eae4a0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lazy-loading 'services' on Instance uuid 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 {{(pid=124712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:43:07.709099 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-2eeff5b4-b78e-41d6-b095-12b396eae4a0 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "DELETE /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4/os-volume_attachments/c94f1c2a-19aa-4f76-b82a-a79dede82279" status: 202 len: 0 microversion: 2.1 time: 0.387916 Jul 20 15:43:07.709525 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 535/1067] 10.222.0.78 () {58 vars in 1415 bytes} [Wed Jul 20 15:43:07 2022] DELETE /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4/os-volume_attachments/c94f1c2a-19aa-4f76-b82a-a79dede82279 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:43:07.719528 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d640c755-0a13-423c-8767-2b546ba0e6cd tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:07.720543 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-d640c755-0a13-423c-8767-2b546ba0e6cd tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:07.726723 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d640c755-0a13-423c-8767-2b546ba0e6cd tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:07.727174 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d640c755-0a13-423c-8767-2b546ba0e6cd tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:07.727937 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d640c755-0a13-423c-8767-2b546ba0e6cd tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:07.728955 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d640c755-0a13-423c-8767-2b546ba0e6cd tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:07.762708 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d640c755-0a13-423c-8767-2b546ba0e6cd tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047952 Jul 20 15:43:07.764463 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 533/1068] 10.222.0.78 () {58 vars in 1301 bytes} [Wed Jul 20 15:43:07 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:43:08.777065 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-f6028752-d61a-408c-9d0d-195e7fc684da tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:08.778168 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-f6028752-d61a-408c-9d0d-195e7fc684da tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:08.784813 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f6028752-d61a-408c-9d0d-195e7fc684da tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:08.787454 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f6028752-d61a-408c-9d0d-195e7fc684da tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:08.787454 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f6028752-d61a-408c-9d0d-195e7fc684da tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:08.787454 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f6028752-d61a-408c-9d0d-195e7fc684da tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:08.820912 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-f6028752-d61a-408c-9d0d-195e7fc684da tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049029 Jul 20 15:43:08.821500 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 536/1069] 10.222.0.78 () {58 vars in 1301 bytes} [Wed Jul 20 15:43:08 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:43:09.832993 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-1e08ebc8-7b0c-490b-9b02-4ede4972048b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:09.833935 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-1e08ebc8-7b0c-490b-9b02-4ede4972048b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:09.841301 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1e08ebc8-7b0c-490b-9b02-4ede4972048b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:09.841811 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1e08ebc8-7b0c-490b-9b02-4ede4972048b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:09.842659 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1e08ebc8-7b0c-490b-9b02-4ede4972048b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:09.843103 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1e08ebc8-7b0c-490b-9b02-4ede4972048b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:09.872148 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-1e08ebc8-7b0c-490b-9b02-4ede4972048b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043166 Jul 20 15:43:09.872700 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 534/1070] 10.222.0.78 () {58 vars in 1301 bytes} [Wed Jul 20 15:43:09 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 15:43:09.929385 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-9c59c113-cf2d-47da-8b3a-c3770e26c002 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:09.929892 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-9c59c113-cf2d-47da-8b3a-c3770e26c002 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:09.936922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9c59c113-cf2d-47da-8b3a-c3770e26c002 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:09.937373 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9c59c113-cf2d-47da-8b3a-c3770e26c002 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:09.938131 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9c59c113-cf2d-47da-8b3a-c3770e26c002 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:09.938592 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9c59c113-cf2d-47da-8b3a-c3770e26c002 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:09.964838 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-9c59c113-cf2d-47da-8b3a-c3770e26c002 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Going to try to terminate instance {{(pid=124712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 15:43:10.342006 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-9c59c113-cf2d-47da-8b3a-c3770e26c002 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "DELETE /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4" status: 204 len: 0 microversion: 2.1 time: 0.416095 Jul 20 15:43:10.342638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 537/1071] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:43:09 2022] DELETE /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 15:43:10.351105 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-73d42083-7db2-4708-9d79-92b15eddc62c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:10.351663 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-73d42083-7db2-4708-9d79-92b15eddc62c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:10.358441 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-73d42083-7db2-4708-9d79-92b15eddc62c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:10.358891 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-73d42083-7db2-4708-9d79-92b15eddc62c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:10.359650 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-73d42083-7db2-4708-9d79-92b15eddc62c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:10.360086 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-73d42083-7db2-4708-9d79-92b15eddc62c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:10.494124 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-73d42083-7db2-4708-9d79-92b15eddc62c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:43:10.501697 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-73d42083-7db2-4708-9d79-92b15eddc62c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4" status: 200 len: 1681 microversion: 2.1 time: 0.154578 Jul 20 15:43:10.502284 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 535/1072] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:43:10 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:43:11.520386 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-18ab029e-437a-43d1-ae25-65c3b4482a2c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:11.521080 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-18ab029e-437a-43d1-ae25-65c3b4482a2c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:11.527270 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-18ab029e-437a-43d1-ae25-65c3b4482a2c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:11.527718 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-18ab029e-437a-43d1-ae25-65c3b4482a2c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:11.528477 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-18ab029e-437a-43d1-ae25-65c3b4482a2c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:11.528908 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-18ab029e-437a-43d1-ae25-65c3b4482a2c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:11.680096 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-18ab029e-437a-43d1-ae25-65c3b4482a2c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:43:11.688323 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-18ab029e-437a-43d1-ae25-65c3b4482a2c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4" status: 200 len: 1681 microversion: 2.1 time: 0.172621 Jul 20 15:43:11.689000 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 538/1073] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:43:11 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:43:12.706504 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-20bc245e-9418-4c56-9513-219e4d3991b5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:12.707207 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-20bc245e-9418-4c56-9513-219e4d3991b5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:12.714833 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-20bc245e-9418-4c56-9513-219e4d3991b5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:12.715279 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-20bc245e-9418-4c56-9513-219e4d3991b5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:12.716085 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-20bc245e-9418-4c56-9513-219e4d3991b5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:12.716514 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-20bc245e-9418-4c56-9513-219e4d3991b5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:12.786440 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-20bc245e-9418-4c56-9513-219e4d3991b5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:43:12.792756 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-20bc245e-9418-4c56-9513-219e4d3991b5 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4" status: 200 len: 1614 microversion: 2.1 time: 0.090520 Jul 20 15:43:12.793386 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 536/1074] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:43:12 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 => generated 1614 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:43:13.445481 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-e902ecf6-905d-4ebf-b248-ae09240bcd86 req-eab06878-2d1c-420c-80d3-31b44e131d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "023a1736-7558-4434-9b4d-4bbe0d9f4ea4", "name": "network-vif-deleted", "tag": "38c141c8-0909-4ef8-8ff6-6a25e3d25531"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:43:13.457836 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-e902ecf6-905d-4ebf-b248-ae09240bcd86 req-eab06878-2d1c-420c-80d3-31b44e131d02 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:13.458667 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-e902ecf6-905d-4ebf-b248-ae09240bcd86 req-eab06878-2d1c-420c-80d3-31b44e131d02 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:13.481224 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-e902ecf6-905d-4ebf-b248-ae09240bcd86 req-eab06878-2d1c-420c-80d3-31b44e131d02 service nova] Creating event network-vif-deleted:38c141c8-0909-4ef8-8ff6-6a25e3d25531 for instance 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 on hv-cinder-81914 Jul 20 15:43:13.491457 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-e902ecf6-905d-4ebf-b248-ae09240bcd86 req-eab06878-2d1c-420c-80d3-31b44e131d02 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192249 Jul 20 15:43:13.492889 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 539/1075] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:43:13.810509 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-de111106-633f-4070-bd0f-7df4c0c9091f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:13.811618 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-de111106-633f-4070-bd0f-7df4c0c9091f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:13.820364 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-de111106-633f-4070-bd0f-7df4c0c9091f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:13.820815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-de111106-633f-4070-bd0f-7df4c0c9091f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:13.822092 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-de111106-633f-4070-bd0f-7df4c0c9091f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:13.822548 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-de111106-633f-4070-bd0f-7df4c0c9091f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:13.860815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-de111106-633f-4070-bd0f-7df4c0c9091f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:13.861266 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-de111106-633f-4070-bd0f-7df4c0c9091f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:13.861720 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.objects.instance [None req-de111106-633f-4070-bd0f-7df4c0c9091f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lazy-loading 'fault' on Instance uuid 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 {{(pid=124711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:43:13.904973 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-de111106-633f-4070-bd0f-7df4c0c9091f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0235b8fe92554131ba30e1d18f0f2d86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44dc2a5c754d42d1862b331afef2183f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:43:13.914945 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-de111106-633f-4070-bd0f-7df4c0c9091f tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4" status: 200 len: 1332 microversion: 2.1 time: 0.108804 Jul 20 15:43:13.915543 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 537/1076] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:43:13 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:43:14.939778 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b1b8686a-3bfb-45ea-9009-cef22fc69575 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:14.940478 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b1b8686a-3bfb-45ea-9009-cef22fc69575 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:14.947184 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b1b8686a-3bfb-45ea-9009-cef22fc69575 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:14.947632 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b1b8686a-3bfb-45ea-9009-cef22fc69575 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:14.948422 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b1b8686a-3bfb-45ea-9009-cef22fc69575 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:14.948858 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b1b8686a-3bfb-45ea-9009-cef22fc69575 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:14.962939 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-b1b8686a-3bfb-45ea-9009-cef22fc69575 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] HTTP exception thrown: Instance 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 could not be found. Jul 20 15:43:14.964540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b1b8686a-3bfb-45ea-9009-cef22fc69575 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Request method failure captured: Jul 20 15:43:14.964540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 HTTP/1.1 Jul 20 15:43:14.964540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:43:14.964540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:43:14.964540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:43:14.964540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:43:14.964540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:43:14.964540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:43:14.964540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:43:14.964540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:43:14.964540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2CFbqu0igtNFkKl4EJaf-GYNIGNf3oPPBh1qR18PSUtcU3V7h-gnPvG3ab7Q5raWMuBmdNqsnWfQ6CrhGLfn4khb0o1UjxQU3L4Zqn7IpPmYId2n8OkZqafcLgphEQCenF6dSjPlKmYhLi2C6LeB66jmX3oFU2bTLIqjrnHhkVSptBA Jul 20 15:43:14.964540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:43:14.964540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:43:14.964540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:43:14.964540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:43:14.964540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:43:14.964540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:43:14.964540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:43:14.964540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:14.964540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:43:14.964540 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:43:14.966057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dc2a5c754d42d1862b331afef2183f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}] Jul 20 15:43:14.966057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:14.966057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:43:14.966057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:14.966057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:43:14.966057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:43:14.966057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:43:14.966057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: 0235b8fe92554131ba30e1d18f0f2d86 Jul 20 15:43:14.966057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:43:14.966057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:43:14.966057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 could not be found. Jul 20 15:43:14.966057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': '023a1736-7558-4434-9b4d-4bbe0d9f4ea4'} Jul 20 15:43:14.966935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:43:14.966935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:14.966935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:43:14.966935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:43:14.966935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:43:14.966935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:43:14.966935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:43:14.966935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:43:14.966935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:43:14.966935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:43:14.966935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 could not be found. Jul 20 15:43:14.966935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:14.966935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:14.966935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:14.966935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:14.966935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:14.966935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:14.966935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:43:14.966935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:43:14.966935 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:43:14.968518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:43:14.968518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:43:14.968518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:43:14.968518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:43:14.968518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:43:14.968518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:43:14.968518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:43:14.968518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 could not be found. Jul 20 15:43:14.968518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:14.968518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:14.968518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:14.968518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:14.968518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:14.968518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:14.968518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:43:14.968518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:43:14.968518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 could not be found. Jul 20 15:43:14.968518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:14.970141 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b1b8686a-3bfb-45ea-9009-cef22fc69575 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Returning 404 to user: Instance 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:43:14.970141 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b1b8686a-3bfb-45ea-9009-cef22fc69575 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4" status: 404 len: 111 microversion: 2.1 time: 0.030432 Jul 20 15:43:14.970141 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 540/1077] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:43:14 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:43:14.974956 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-061a365a-f2c7-44ed-bf7c-7be374d37d2b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '.version_select at 0x7efd90cb9ee0>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:15.139511 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-061a365a-f2c7-44ed-bf7c-7be374d37d2b tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774159353" status: 202 len: 0 microversion: 2.1 time: 0.168105 Jul 20 15:43:15.140083 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 538/1078] 10.222.0.78 () {58 vars in 1220 bytes} [Wed Jul 20 15:43:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1774159353 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:43:17.361635 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b962f7d1-289f-4818-8ee0-a049078d0f68 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:17.362117 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b962f7d1-289f-4818-8ee0-a049078d0f68 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:17.368735 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b962f7d1-289f-4818-8ee0-a049078d0f68 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:17.369183 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b962f7d1-289f-4818-8ee0-a049078d0f68 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:17.369932 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b962f7d1-289f-4818-8ee0-a049078d0f68 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:17.370420 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b962f7d1-289f-4818-8ee0-a049078d0f68 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:17.383719 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-b962f7d1-289f-4818-8ee0-a049078d0f68 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] HTTP exception thrown: Instance 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 could not be found. Jul 20 15:43:17.385237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b962f7d1-289f-4818-8ee0-a049078d0f68 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Request method failure captured: Jul 20 15:43:17.385237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: DELETE /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 HTTP/1.1 Jul 20 15:43:17.385237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:43:17.385237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:43:17.385237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:43:17.385237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:43:17.385237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:43:17.385237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:43:17.385237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:43:17.385237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:43:17.385237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2CFbqu0igtNFkKl4EJaf-GYNIGNf3oPPBh1qR18PSUtcU3V7h-gnPvG3ab7Q5raWMuBmdNqsnWfQ6CrhGLfn4khb0o1UjxQU3L4Zqn7IpPmYId2n8OkZqafcLgphEQCenF6dSjPlKmYhLi2C6LeB66jmX3oFU2bTLIqjrnHhkVSptBA Jul 20 15:43:17.385237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:43:17.385237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:43:17.385237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:43:17.385237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:43:17.385237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:43:17.385237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:43:17.385237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:43:17.385237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:17.385237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:43:17.385237 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:43:17.386682 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dc2a5c754d42d1862b331afef2183f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}] Jul 20 15:43:17.386682 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:17.386682 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:43:17.386682 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:17.386682 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:43:17.386682 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:43:17.386682 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:43:17.386682 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: 0235b8fe92554131ba30e1d18f0f2d86 Jul 20 15:43:17.386682 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:43:17.386682 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:43:17.386682 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 could not be found. Jul 20 15:43:17.386682 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': '023a1736-7558-4434-9b4d-4bbe0d9f4ea4'} Jul 20 15:43:17.387471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:43:17.387471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:17.387471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:43:17.387471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:43:17.387471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:43:17.387471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:43:17.387471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:43:17.387471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:43:17.387471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:43:17.387471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:43:17.387471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 could not be found. Jul 20 15:43:17.387471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:17.387471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:17.387471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:17.387471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:17.387471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:17.387471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:17.387471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:43:17.387471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:43:17.387471 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:43:17.388969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:43:17.388969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 15:43:17.388969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 15:43:17.388969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 15:43:17.388969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 15:43:17.388969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:43:17.388969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:43:17.388969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:43:17.388969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:43:17.388969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 could not be found. Jul 20 15:43:17.388969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:17.388969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:17.388969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:17.388969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:17.388969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:17.388969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:17.388969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:43:17.388969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:43:17.388969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 could not be found. Jul 20 15:43:17.388969 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:17.390650 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b962f7d1-289f-4818-8ee0-a049078d0f68 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Returning 404 to user: Instance 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:43:17.390650 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b962f7d1-289f-4818-8ee0-a049078d0f68 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "DELETE /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4" status: 404 len: 111 microversion: 2.1 time: 0.028790 Jul 20 15:43:17.390650 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 541/1079] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:43:17 2022] DELETE /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:43:17.395643 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-1649c06d-6bb7-4321-9a32-cf0da1cfee4e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:17.396263 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-1649c06d-6bb7-4321-9a32-cf0da1cfee4e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 023a1736-7558-4434-9b4d-4bbe0d9f4ea4] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:17.403531 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1649c06d-6bb7-4321-9a32-cf0da1cfee4e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:17.403984 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1649c06d-6bb7-4321-9a32-cf0da1cfee4e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:17.404749 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1649c06d-6bb7-4321-9a32-cf0da1cfee4e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:17.405187 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1649c06d-6bb7-4321-9a32-cf0da1cfee4e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:17.418784 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-1649c06d-6bb7-4321-9a32-cf0da1cfee4e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] HTTP exception thrown: Instance 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 could not be found. Jul 20 15:43:17.420458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-1649c06d-6bb7-4321-9a32-cf0da1cfee4e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Request method failure captured: Jul 20 15:43:17.420458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 HTTP/1.1 Jul 20 15:43:17.420458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:43:17.420458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:43:17.420458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:43:17.420458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:43:17.420458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:43:17.420458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:43:17.420458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:43:17.420458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:43:17.420458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2CFbqu0igtNFkKl4EJaf-GYNIGNf3oPPBh1qR18PSUtcU3V7h-gnPvG3ab7Q5raWMuBmdNqsnWfQ6CrhGLfn4khb0o1UjxQU3L4Zqn7IpPmYId2n8OkZqafcLgphEQCenF6dSjPlKmYhLi2C6LeB66jmX3oFU2bTLIqjrnHhkVSptBA Jul 20 15:43:17.420458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:43:17.420458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:43:17.420458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:43:17.420458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:43:17.420458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:43:17.420458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:43:17.420458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:43:17.420458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:17.420458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:43:17.420458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:43:17.422096 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dc2a5c754d42d1862b331afef2183f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}] Jul 20 15:43:17.422096 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:17.422096 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:43:17.422096 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:17.422096 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:43:17.422096 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:43:17.422096 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:43:17.422096 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: 0235b8fe92554131ba30e1d18f0f2d86 Jul 20 15:43:17.422096 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:43:17.422096 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: > Jul 20 15:43:17.422096 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Instance 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 could not be found. Jul 20 15:43:17.422096 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': '023a1736-7558-4434-9b4d-4bbe0d9f4ea4'} Jul 20 15:43:17.423139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:43:17.423139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:17.423139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:43:17.423139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:43:17.423139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:43:17.423139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:43:17.423139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:43:17.423139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:43:17.423139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:43:17.423139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:43:17.423139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 could not be found. Jul 20 15:43:17.423139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:17.423139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:17.423139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:17.423139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:17.423139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:17.423139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:17.423139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:43:17.423139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:43:17.423139 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:43:17.424825 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:43:17.424825 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:43:17.424825 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:43:17.424825 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:43:17.424825 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:43:17.424825 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:43:17.424825 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:43:17.424825 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 could not be found. Jul 20 15:43:17.424825 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:17.424825 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:17.424825 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:17.424825 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:17.424825 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:17.424825 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:17.424825 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:43:17.424825 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:43:17.424825 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 could not be found. Jul 20 15:43:17.424825 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:17.426382 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-1649c06d-6bb7-4321-9a32-cf0da1cfee4e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Returning 404 to user: Instance 023a1736-7558-4434-9b4d-4bbe0d9f4ea4 could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:43:17.426382 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-1649c06d-6bb7-4321-9a32-cf0da1cfee4e tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4" status: 404 len: 111 microversion: 2.1 time: 0.030595 Jul 20 15:43:17.426382 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 539/1080] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:43:17 2022] GET /compute/v2.1/servers/023a1736-7558-4434-9b4d-4bbe0d9f4ea4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:43:18.817375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-edc37b4f-d71c-45dd-b89e-a43701dca65c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:18.817375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-edc37b4f-d71c-45dd-b89e-a43701dca65c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:18.817375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-edc37b4f-d71c-45dd-b89e-a43701dca65c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:18.818465 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-edc37b4f-d71c-45dd-b89e-a43701dca65c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:18.818645 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-edc37b4f-d71c-45dd-b89e-a43701dca65c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:18.819088 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-edc37b4f-d71c-45dd-b89e-a43701dca65c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:18.833136 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-edc37b4f-d71c-45dd-b89e-a43701dca65c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] HTTP exception thrown: Instance 34721a3c-bac8-4cea-9f1d-6ee067b62ade could not be found. Jul 20 15:43:18.834913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-edc37b4f-d71c-45dd-b89e-a43701dca65c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Request method failure captured: Jul 20 15:43:18.834913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: DELETE /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade HTTP/1.1 Jul 20 15:43:18.834913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:43:18.834913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:43:18.834913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:43:18.834913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:43:18.834913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:43:18.834913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:43:18.834913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:43:18.834913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:43:18.834913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2CFbqu0igtNFkKl4EJaf-GYNIGNf3oPPBh1qR18PSUtcU3V7h-gnPvG3ab7Q5raWMuBmdNqsnWfQ6CrhGLfn4khb0o1UjxQU3L4Zqn7IpPmYId2n8OkZqafcLgphEQCenF6dSjPlKmYhLi2C6LeB66jmX3oFU2bTLIqjrnHhkVSptBA Jul 20 15:43:18.834913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:43:18.834913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:43:18.834913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:43:18.834913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:43:18.834913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:43:18.834913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:43:18.834913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:43:18.834913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:18.834913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:43:18.834913 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:43:18.837963 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dc2a5c754d42d1862b331afef2183f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}] Jul 20 15:43:18.837963 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:18.837963 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:43:18.837963 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:18.837963 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:43:18.837963 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:43:18.837963 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:43:18.837963 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: 0235b8fe92554131ba30e1d18f0f2d86 Jul 20 15:43:18.837963 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:43:18.837963 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:43:18.837963 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance 34721a3c-bac8-4cea-9f1d-6ee067b62ade could not be found. Jul 20 15:43:18.837963 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': '34721a3c-bac8-4cea-9f1d-6ee067b62ade'} Jul 20 15:43:18.839387 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:43:18.839387 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:18.839387 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:43:18.839387 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:43:18.839387 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:43:18.839387 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:43:18.839387 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:43:18.839387 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:43:18.839387 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:43:18.839387 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:43:18.839387 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34721a3c-bac8-4cea-9f1d-6ee067b62ade could not be found. Jul 20 15:43:18.839387 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:18.839387 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:18.839387 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:18.839387 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:18.839387 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:18.839387 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:18.839387 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:43:18.839387 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:43:18.839387 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:43:18.841917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:43:18.841917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 15:43:18.841917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 15:43:18.841917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 15:43:18.841917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 15:43:18.841917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:43:18.841917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:43:18.841917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:43:18.841917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:43:18.841917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34721a3c-bac8-4cea-9f1d-6ee067b62ade could not be found. Jul 20 15:43:18.841917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:18.841917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:18.841917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:18.841917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:18.841917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:18.841917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:18.841917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:43:18.841917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:43:18.841917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34721a3c-bac8-4cea-9f1d-6ee067b62ade could not be found. Jul 20 15:43:18.841917 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:18.844276 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-edc37b4f-d71c-45dd-b89e-a43701dca65c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Returning 404 to user: Instance 34721a3c-bac8-4cea-9f1d-6ee067b62ade could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:43:18.844276 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-edc37b4f-d71c-45dd-b89e-a43701dca65c tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "DELETE /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade" status: 404 len: 111 microversion: 2.1 time: 0.030830 Jul 20 15:43:18.844276 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 542/1081] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:43:18 2022] DELETE /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:43:18.845713 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-564ad8c1-cc50-4f0f-9a07-14383a6debf4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:18.853326 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-564ad8c1-cc50-4f0f-9a07-14383a6debf4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 34721a3c-bac8-4cea-9f1d-6ee067b62ade] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:18.853456 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-564ad8c1-cc50-4f0f-9a07-14383a6debf4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:18.853933 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-564ad8c1-cc50-4f0f-9a07-14383a6debf4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:18.854723 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-564ad8c1-cc50-4f0f-9a07-14383a6debf4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:18.855185 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-564ad8c1-cc50-4f0f-9a07-14383a6debf4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:18.868525 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-564ad8c1-cc50-4f0f-9a07-14383a6debf4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] HTTP exception thrown: Instance 34721a3c-bac8-4cea-9f1d-6ee067b62ade could not be found. Jul 20 15:43:18.870027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-564ad8c1-cc50-4f0f-9a07-14383a6debf4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Request method failure captured: Jul 20 15:43:18.870027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade HTTP/1.1 Jul 20 15:43:18.870027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:43:18.870027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:43:18.870027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:43:18.870027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:43:18.870027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:43:18.870027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:43:18.870027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:43:18.870027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:43:18.870027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2CFbqu0igtNFkKl4EJaf-GYNIGNf3oPPBh1qR18PSUtcU3V7h-gnPvG3ab7Q5raWMuBmdNqsnWfQ6CrhGLfn4khb0o1UjxQU3L4Zqn7IpPmYId2n8OkZqafcLgphEQCenF6dSjPlKmYhLi2C6LeB66jmX3oFU2bTLIqjrnHhkVSptBA Jul 20 15:43:18.870027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:43:18.870027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:43:18.870027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:43:18.870027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:43:18.870027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:43:18.870027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:43:18.870027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:43:18.870027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:18.870027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:43:18.870027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:43:18.871812 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dc2a5c754d42d1862b331afef2183f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}] Jul 20 15:43:18.871812 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:18.871812 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:43:18.871812 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:18.871812 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:43:18.871812 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:43:18.871812 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:43:18.871812 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: 0235b8fe92554131ba30e1d18f0f2d86 Jul 20 15:43:18.871812 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:43:18.871812 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: > Jul 20 15:43:18.871812 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Instance 34721a3c-bac8-4cea-9f1d-6ee067b62ade could not be found. Jul 20 15:43:18.871812 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': '34721a3c-bac8-4cea-9f1d-6ee067b62ade'} Jul 20 15:43:18.872829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:43:18.872829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:18.872829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:43:18.872829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:43:18.872829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:43:18.872829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:43:18.872829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:43:18.872829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:43:18.872829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:43:18.872829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:43:18.872829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34721a3c-bac8-4cea-9f1d-6ee067b62ade could not be found. Jul 20 15:43:18.872829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:18.872829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:18.872829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:18.872829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:18.872829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:18.872829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:18.872829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:43:18.872829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:43:18.872829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:43:18.874494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:43:18.874494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:43:18.874494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:43:18.874494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:43:18.874494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:43:18.874494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:43:18.874494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:43:18.874494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34721a3c-bac8-4cea-9f1d-6ee067b62ade could not be found. Jul 20 15:43:18.874494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:18.874494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:18.874494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:18.874494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:18.874494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:18.874494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:18.874494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:43:18.874494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:43:18.874494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34721a3c-bac8-4cea-9f1d-6ee067b62ade could not be found. Jul 20 15:43:18.874494 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:18.875849 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-564ad8c1-cc50-4f0f-9a07-14383a6debf4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Returning 404 to user: Instance 34721a3c-bac8-4cea-9f1d-6ee067b62ade could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:43:18.875849 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-564ad8c1-cc50-4f0f-9a07-14383a6debf4 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade" status: 404 len: 111 microversion: 2.1 time: 0.029625 Jul 20 15:43:18.875849 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 540/1082] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:43:18 2022] GET /compute/v2.1/servers/34721a3c-bac8-4cea-9f1d-6ee067b62ade => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:43:18.881659 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-76ac753c-b030-4974-b8a3-94b797bdc027 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:18.882164 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-76ac753c-b030-4974-b8a3-94b797bdc027 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:18.888646 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-76ac753c-b030-4974-b8a3-94b797bdc027 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:18.889124 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-76ac753c-b030-4974-b8a3-94b797bdc027 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:18.889910 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-76ac753c-b030-4974-b8a3-94b797bdc027 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:18.890409 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-76ac753c-b030-4974-b8a3-94b797bdc027 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:18.904682 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-76ac753c-b030-4974-b8a3-94b797bdc027 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] HTTP exception thrown: Instance 84c1c67f-27a0-475d-9897-10786bf0bc74 could not be found. Jul 20 15:43:18.906272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-76ac753c-b030-4974-b8a3-94b797bdc027 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Request method failure captured: Jul 20 15:43:18.906272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: DELETE /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 HTTP/1.1 Jul 20 15:43:18.906272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:43:18.906272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:43:18.906272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:43:18.906272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:43:18.906272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:43:18.906272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:43:18.906272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:43:18.906272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:43:18.906272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2CFbqu0igtNFkKl4EJaf-GYNIGNf3oPPBh1qR18PSUtcU3V7h-gnPvG3ab7Q5raWMuBmdNqsnWfQ6CrhGLfn4khb0o1UjxQU3L4Zqn7IpPmYId2n8OkZqafcLgphEQCenF6dSjPlKmYhLi2C6LeB66jmX3oFU2bTLIqjrnHhkVSptBA Jul 20 15:43:18.906272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:43:18.906272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:43:18.906272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:43:18.906272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:43:18.906272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:43:18.906272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:43:18.906272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:43:18.906272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:18.906272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:43:18.906272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:43:18.908155 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dc2a5c754d42d1862b331afef2183f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}] Jul 20 15:43:18.908155 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:18.908155 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:43:18.908155 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:18.908155 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:43:18.908155 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:43:18.908155 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:43:18.908155 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: 0235b8fe92554131ba30e1d18f0f2d86 Jul 20 15:43:18.908155 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:43:18.908155 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:43:18.908155 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance 84c1c67f-27a0-475d-9897-10786bf0bc74 could not be found. Jul 20 15:43:18.908155 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': '84c1c67f-27a0-475d-9897-10786bf0bc74'} Jul 20 15:43:18.909272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:43:18.909272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:18.909272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:43:18.909272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:43:18.909272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:43:18.909272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:43:18.909272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:43:18.909272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:43:18.909272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:43:18.909272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:43:18.909272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84c1c67f-27a0-475d-9897-10786bf0bc74 could not be found. Jul 20 15:43:18.909272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:18.909272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:18.909272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:18.909272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:18.909272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:18.909272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:18.909272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:43:18.909272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:43:18.909272 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:43:18.910993 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:43:18.910993 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 15:43:18.910993 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 15:43:18.910993 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 15:43:18.910993 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 15:43:18.910993 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:43:18.910993 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:43:18.910993 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:43:18.910993 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:43:18.910993 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84c1c67f-27a0-475d-9897-10786bf0bc74 could not be found. Jul 20 15:43:18.910993 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:18.910993 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:18.910993 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:18.910993 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:18.910993 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:18.910993 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:18.910993 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:43:18.910993 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:43:18.910993 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84c1c67f-27a0-475d-9897-10786bf0bc74 could not be found. Jul 20 15:43:18.910993 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:18.912474 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-76ac753c-b030-4974-b8a3-94b797bdc027 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Returning 404 to user: Instance 84c1c67f-27a0-475d-9897-10786bf0bc74 could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:43:18.912474 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-76ac753c-b030-4974-b8a3-94b797bdc027 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "DELETE /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 404 len: 111 microversion: 2.1 time: 0.029920 Jul 20 15:43:18.912474 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 543/1083] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:43:18 2022] DELETE /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:43:18.918743 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5e2effb4-c0bf-44c9-a1bc-243f0adc7ffc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:18.919356 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5e2effb4-c0bf-44c9-a1bc-243f0adc7ffc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: 84c1c67f-27a0-475d-9897-10786bf0bc74] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:18.925613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e2effb4-c0bf-44c9-a1bc-243f0adc7ffc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:18.926151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e2effb4-c0bf-44c9-a1bc-243f0adc7ffc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:18.926947 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e2effb4-c0bf-44c9-a1bc-243f0adc7ffc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:18.927378 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e2effb4-c0bf-44c9-a1bc-243f0adc7ffc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:18.940812 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-5e2effb4-c0bf-44c9-a1bc-243f0adc7ffc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] HTTP exception thrown: Instance 84c1c67f-27a0-475d-9897-10786bf0bc74 could not be found. Jul 20 15:43:18.942347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5e2effb4-c0bf-44c9-a1bc-243f0adc7ffc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Request method failure captured: Jul 20 15:43:18.942347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 HTTP/1.1 Jul 20 15:43:18.942347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:43:18.942347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:43:18.942347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:43:18.942347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:43:18.942347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:43:18.942347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:43:18.942347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:43:18.942347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:43:18.942347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2CFbqu0igtNFkKl4EJaf-GYNIGNf3oPPBh1qR18PSUtcU3V7h-gnPvG3ab7Q5raWMuBmdNqsnWfQ6CrhGLfn4khb0o1UjxQU3L4Zqn7IpPmYId2n8OkZqafcLgphEQCenF6dSjPlKmYhLi2C6LeB66jmX3oFU2bTLIqjrnHhkVSptBA Jul 20 15:43:18.942347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:43:18.942347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:43:18.942347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:43:18.942347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:43:18.942347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:43:18.942347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:43:18.942347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:43:18.942347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:18.942347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:43:18.942347 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:43:18.945332 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dc2a5c754d42d1862b331afef2183f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}] Jul 20 15:43:18.945332 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:18.945332 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:43:18.945332 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:18.945332 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:43:18.945332 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:43:18.945332 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:43:18.945332 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: 0235b8fe92554131ba30e1d18f0f2d86 Jul 20 15:43:18.945332 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:43:18.945332 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: > Jul 20 15:43:18.945332 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Instance 84c1c67f-27a0-475d-9897-10786bf0bc74 could not be found. Jul 20 15:43:18.945332 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': '84c1c67f-27a0-475d-9897-10786bf0bc74'} Jul 20 15:43:18.946980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:43:18.946980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:18.946980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:43:18.946980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:43:18.946980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:43:18.946980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:43:18.946980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:43:18.946980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:43:18.946980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:43:18.946980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:43:18.946980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84c1c67f-27a0-475d-9897-10786bf0bc74 could not be found. Jul 20 15:43:18.946980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:18.946980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:18.946980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:18.946980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:18.946980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:18.946980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:18.946980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:43:18.946980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:43:18.946980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:43:18.948711 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:43:18.948711 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:43:18.948711 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:43:18.948711 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:43:18.948711 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:43:18.948711 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:43:18.948711 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:43:18.948711 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84c1c67f-27a0-475d-9897-10786bf0bc74 could not be found. Jul 20 15:43:18.948711 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:18.948711 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:18.948711 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:18.948711 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:18.948711 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:18.948711 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:18.948711 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:43:18.948711 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:43:18.948711 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84c1c67f-27a0-475d-9897-10786bf0bc74 could not be found. Jul 20 15:43:18.948711 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:18.950411 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5e2effb4-c0bf-44c9-a1bc-243f0adc7ffc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Returning 404 to user: Instance 84c1c67f-27a0-475d-9897-10786bf0bc74 could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:43:18.950411 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5e2effb4-c0bf-44c9-a1bc-243f0adc7ffc tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74" status: 404 len: 111 microversion: 2.1 time: 0.029531 Jul 20 15:43:18.950411 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 541/1084] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:43:18 2022] GET /compute/v2.1/servers/84c1c67f-27a0-475d-9897-10786bf0bc74 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:43:20.335685 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-1bde4155-0f31-4fa3-ba03-d827f896e9f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:20.336217 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-1bde4155-0f31-4fa3-ba03-d827f896e9f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:20.343801 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1bde4155-0f31-4fa3-ba03-d827f896e9f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:20.344293 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1bde4155-0f31-4fa3-ba03-d827f896e9f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:20.345090 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1bde4155-0f31-4fa3-ba03-d827f896e9f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:20.345529 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-1bde4155-0f31-4fa3-ba03-d827f896e9f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:20.360784 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-1bde4155-0f31-4fa3-ba03-d827f896e9f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] HTTP exception thrown: Instance b0789091-c337-4b8d-b1b5-02144d153dcc could not be found. Jul 20 15:43:20.362430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-1bde4155-0f31-4fa3-ba03-d827f896e9f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Request method failure captured: Jul 20 15:43:20.362430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: DELETE /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc HTTP/1.1 Jul 20 15:43:20.362430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:43:20.362430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:43:20.362430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:43:20.362430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:43:20.362430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:43:20.362430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:43:20.362430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:43:20.362430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:43:20.362430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2CFbqu0igtNFkKl4EJaf-GYNIGNf3oPPBh1qR18PSUtcU3V7h-gnPvG3ab7Q5raWMuBmdNqsnWfQ6CrhGLfn4khb0o1UjxQU3L4Zqn7IpPmYId2n8OkZqafcLgphEQCenF6dSjPlKmYhLi2C6LeB66jmX3oFU2bTLIqjrnHhkVSptBA Jul 20 15:43:20.362430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:43:20.362430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:43:20.362430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:43:20.362430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:43:20.362430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:43:20.362430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:43:20.362430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:43:20.362430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:20.362430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:43:20.362430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:43:20.364034 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dc2a5c754d42d1862b331afef2183f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}] Jul 20 15:43:20.364034 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:20.364034 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:43:20.364034 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:20.364034 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:43:20.364034 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:43:20.364034 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:43:20.364034 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: 0235b8fe92554131ba30e1d18f0f2d86 Jul 20 15:43:20.364034 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:43:20.364034 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:43:20.364034 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance b0789091-c337-4b8d-b1b5-02144d153dcc could not be found. Jul 20 15:43:20.364034 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': 'b0789091-c337-4b8d-b1b5-02144d153dcc'} Jul 20 15:43:20.364827 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:43:20.364827 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:20.364827 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:43:20.364827 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:43:20.364827 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:43:20.364827 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:43:20.364827 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:43:20.364827 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:43:20.364827 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:43:20.364827 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:43:20.364827 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0789091-c337-4b8d-b1b5-02144d153dcc could not be found. Jul 20 15:43:20.364827 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:20.364827 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:20.364827 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:20.364827 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:20.364827 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:20.364827 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:20.364827 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:43:20.364827 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:43:20.364827 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:43:20.366100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:43:20.366100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 15:43:20.366100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 15:43:20.366100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 15:43:20.366100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 15:43:20.366100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:43:20.366100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:43:20.366100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:43:20.366100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:43:20.366100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0789091-c337-4b8d-b1b5-02144d153dcc could not be found. Jul 20 15:43:20.366100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:20.366100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:20.366100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:20.366100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:20.366100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:20.366100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:20.366100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:43:20.366100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:43:20.366100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0789091-c337-4b8d-b1b5-02144d153dcc could not be found. Jul 20 15:43:20.366100 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:20.367495 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-1bde4155-0f31-4fa3-ba03-d827f896e9f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Returning 404 to user: Instance b0789091-c337-4b8d-b1b5-02144d153dcc could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:43:20.367495 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-1bde4155-0f31-4fa3-ba03-d827f896e9f2 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc" status: 404 len: 111 microversion: 2.1 time: 0.032172 Jul 20 15:43:20.367495 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 544/1085] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:43:20 2022] DELETE /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:43:20.372448 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-8fc4fb41-c83e-49fb-a859-1aee0da02b40 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:20.373231 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-8fc4fb41-c83e-49fb-a859-1aee0da02b40 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] [instance: b0789091-c337-4b8d-b1b5-02144d153dcc] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:20.380174 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8fc4fb41-c83e-49fb-a859-1aee0da02b40 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:20.380625 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8fc4fb41-c83e-49fb-a859-1aee0da02b40 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:20.381391 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8fc4fb41-c83e-49fb-a859-1aee0da02b40 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:20.381831 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-8fc4fb41-c83e-49fb-a859-1aee0da02b40 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:20.395450 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-8fc4fb41-c83e-49fb-a859-1aee0da02b40 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] HTTP exception thrown: Instance b0789091-c337-4b8d-b1b5-02144d153dcc could not be found. Jul 20 15:43:20.396990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-8fc4fb41-c83e-49fb-a859-1aee0da02b40 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Request method failure captured: Jul 20 15:43:20.396990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc HTTP/1.1 Jul 20 15:43:20.396990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:43:20.396990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:43:20.396990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:43:20.396990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:43:20.396990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:43:20.396990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:43:20.396990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:43:20.396990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:43:20.396990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2CFbqu0igtNFkKl4EJaf-GYNIGNf3oPPBh1qR18PSUtcU3V7h-gnPvG3ab7Q5raWMuBmdNqsnWfQ6CrhGLfn4khb0o1UjxQU3L4Zqn7IpPmYId2n8OkZqafcLgphEQCenF6dSjPlKmYhLi2C6LeB66jmX3oFU2bTLIqjrnHhkVSptBA Jul 20 15:43:20.396990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:43:20.396990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:43:20.396990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:43:20.396990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:43:20.396990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:43:20.396990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:43:20.396990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:43:20.396990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:20.396990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:43:20.396990 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:43:20.400009 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44dc2a5c754d42d1862b331afef2183f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44dc2a5c754d42d1862b331afef2183f", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44dc2a5c754d42d1862b331afef2183f"}]}] Jul 20 15:43:20.400009 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:20.400009 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: 44dc2a5c754d42d1862b331afef2183f Jul 20 15:43:20.400009 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1794101176 Jul 20 15:43:20.400009 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:43:20.400009 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:43:20.400009 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:43:20.400009 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: 0235b8fe92554131ba30e1d18f0f2d86 Jul 20 15:43:20.400009 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-AttachVolumeNegativeTest-1794101176-project Jul 20 15:43:20.400009 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: > Jul 20 15:43:20.400009 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Instance b0789091-c337-4b8d-b1b5-02144d153dcc could not be found. Jul 20 15:43:20.400009 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': 'b0789091-c337-4b8d-b1b5-02144d153dcc'} Jul 20 15:43:20.401396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:43:20.401396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:20.401396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:43:20.401396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:43:20.401396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:43:20.401396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:43:20.401396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:43:20.401396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:43:20.401396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:43:20.401396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:43:20.401396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0789091-c337-4b8d-b1b5-02144d153dcc could not be found. Jul 20 15:43:20.401396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:20.401396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:20.401396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:20.401396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:20.401396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:20.401396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:20.401396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:43:20.401396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:43:20.401396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:43:20.403736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:43:20.403736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:43:20.403736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:43:20.403736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:43:20.403736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:43:20.403736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:43:20.403736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:43:20.403736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0789091-c337-4b8d-b1b5-02144d153dcc could not be found. Jul 20 15:43:20.403736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:20.403736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:20.403736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:20.403736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:20.403736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:20.403736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:20.403736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:43:20.403736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:43:20.403736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0789091-c337-4b8d-b1b5-02144d153dcc could not be found. Jul 20 15:43:20.403736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:20.406059 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-8fc4fb41-c83e-49fb-a859-1aee0da02b40 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] Returning 404 to user: Instance b0789091-c337-4b8d-b1b5-02144d153dcc could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:43:20.406059 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-8fc4fb41-c83e-49fb-a859-1aee0da02b40 tempest-AttachVolumeNegativeTest-1794101176 tempest-AttachVolumeNegativeTest-1794101176-project] 10.222.0.78 "GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc" status: 404 len: 111 microversion: 2.1 time: 0.029793 Jul 20 15:43:20.406059 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 542/1086] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:43:20 2022] GET /compute/v2.1/servers/b0789091-c337-4b8d-b1b5-02144d153dcc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:43:26.857545 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-daebfab8-4ac9-4e2c-8234-57e38d3e709d tempest-VolumesGetTestJSON-1717406237 tempest-VolumesGetTestJSON-1717406237-project] Action: 'create', calling method: .version_select at 0x7efd90b6bd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-97219441", "metadata": {"Type": "work"}}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:43:27.604005 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-daebfab8-4ac9-4e2c-8234-57e38d3e709d tempest-VolumesGetTestJSON-1717406237 tempest-VolumesGetTestJSON-1717406237-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 0.865285 Jul 20 15:43:27.604773 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 545/1087] 10.222.0.78 () {60 vars in 1155 bytes} [Wed Jul 20 15:43:26 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 867 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 15:43:27.617719 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-a150b9b2-7f3a-4778-b977-62f769f8dc76 tempest-VolumesGetTestJSON-1717406237 tempest-VolumesGetTestJSON-1717406237-project] Calling method '.version_select at 0x7efd90a53af0>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:27.672541 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-a150b9b2-7f3a-4778-b977-62f769f8dc76 tempest-VolumesGetTestJSON-1717406237 tempest-VolumesGetTestJSON-1717406237-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/f13f680c-afaf-4cf9-ab55-211357416693" status: 200 len: 351 microversion: 2.1 time: 0.059407 Jul 20 15:43:27.673252 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 543/1088] 10.222.0.78 () {58 vars in 1244 bytes} [Wed Jul 20 15:43:27 2022] GET /compute/v2.1/os-volumes/f13f680c-afaf-4cf9-ab55-211357416693 => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:43:28.685476 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-78bdd804-0c52-464f-8283-b09fa6b935e5 tempest-VolumesGetTestJSON-1717406237 tempest-VolumesGetTestJSON-1717406237-project] Calling method '.version_select at 0x7efd909464c0>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:28.733299 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-78bdd804-0c52-464f-8283-b09fa6b935e5 tempest-VolumesGetTestJSON-1717406237 tempest-VolumesGetTestJSON-1717406237-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/f13f680c-afaf-4cf9-ab55-211357416693" status: 200 len: 352 microversion: 2.1 time: 0.052197 Jul 20 15:43:28.733890 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 546/1089] 10.222.0.78 () {58 vars in 1244 bytes} [Wed Jul 20 15:43:28 2022] GET /compute/v2.1/os-volumes/f13f680c-afaf-4cf9-ab55-211357416693 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:43:28.745123 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-00cef215-66c7-4ade-9082-7993f4c9007b tempest-VolumesGetTestJSON-1717406237 tempest-VolumesGetTestJSON-1717406237-project] Calling method '.version_select at 0x7efd90cd8550>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:28.799799 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-00cef215-66c7-4ade-9082-7993f4c9007b tempest-VolumesGetTestJSON-1717406237 tempest-VolumesGetTestJSON-1717406237-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/f13f680c-afaf-4cf9-ab55-211357416693" status: 200 len: 352 microversion: 2.1 time: 0.058811 Jul 20 15:43:28.800532 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 544/1090] 10.222.0.78 () {58 vars in 1244 bytes} [Wed Jul 20 15:43:28 2022] GET /compute/v2.1/os-volumes/f13f680c-afaf-4cf9-ab55-211357416693 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:43:28.811963 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-8a267ddf-35a2-46db-8324-0ef290913a2a tempest-VolumesGetTestJSON-1717406237 tempest-VolumesGetTestJSON-1717406237-project] Calling method '.version_select at 0x7efd90bcad30>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:29.104514 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-8a267ddf-35a2-46db-8324-0ef290913a2a tempest-VolumesGetTestJSON-1717406237 tempest-VolumesGetTestJSON-1717406237-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/f13f680c-afaf-4cf9-ab55-211357416693" status: 202 len: 0 microversion: 2.1 time: 0.296393 Jul 20 15:43:29.105305 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 547/1091] 10.222.0.78 () {58 vars in 1247 bytes} [Wed Jul 20 15:43:28 2022] DELETE /compute/v2.1/os-volumes/f13f680c-afaf-4cf9-ab55-211357416693 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:43:29.114894 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-43e3b071-ebf6-4fd2-9f94-bd0993b07674 tempest-VolumesGetTestJSON-1717406237 tempest-VolumesGetTestJSON-1717406237-project] Calling method '.version_select at 0x7efd90a07b80>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:29.179707 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-43e3b071-ebf6-4fd2-9f94-bd0993b07674 tempest-VolumesGetTestJSON-1717406237 tempest-VolumesGetTestJSON-1717406237-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/f13f680c-afaf-4cf9-ab55-211357416693" status: 200 len: 351 microversion: 2.1 time: 0.064030 Jul 20 15:43:29.179707 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 545/1092] 10.222.0.78 () {58 vars in 1244 bytes} [Wed Jul 20 15:43:29 2022] GET /compute/v2.1/os-volumes/f13f680c-afaf-4cf9-ab55-211357416693 => generated 351 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:43:30.188381 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-653939b3-c4c3-47b5-8fa9-b2e36b8f6ad1 tempest-VolumesGetTestJSON-1717406237 tempest-VolumesGetTestJSON-1717406237-project] Calling method '.version_select at 0x7efd907f94c0>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:30.216518 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-653939b3-c4c3-47b5-8fa9-b2e36b8f6ad1 tempest-VolumesGetTestJSON-1717406237 tempest-VolumesGetTestJSON-1717406237-project] HTTP exception thrown: Volume f13f680c-afaf-4cf9-ab55-211357416693 could not be found. Jul 20 15:43:30.218851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-653939b3-c4c3-47b5-8fa9-b2e36b8f6ad1 tempest-VolumesGetTestJSON-1717406237 tempest-VolumesGetTestJSON-1717406237-project] Request method failure captured: Jul 20 15:43:30.218851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: GET /compute/v2.1/os-volumes/f13f680c-afaf-4cf9-ab55-211357416693 HTTP/1.1 Jul 20 15:43:30.218851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:43:30.218851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:43:30.218851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:43:30.218851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:43:30.218851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:43:30.218851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:43:30.218851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:43:30.218851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:43:30.218851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2CKepEFAm_AqkBFQGyIOc49fq5owYxLuxEX5KQPFTB7jJI9IAbc9AO8IyMtMo6g-bFDkXL64uINkM4XV_yXWRyEr68tAfgq52XopTSDztxP0Srpq-i0dNifXAAkgTR-FfESgv0m2c3OEhcb7GMaZVy-NOYpyQWAqSvWEhje9C8Ayy7o Jul 20 15:43:30.218851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:43:30.218851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:43:30.218851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:43:30.218851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:43:30.218851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:43:30.218851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:43:30.218851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: a10f937788ef46399485d2b830a4e77a Jul 20 15:43:30.218851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-VolumesGetTestJSON-1717406237 Jul 20 15:43:30.218851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:43:30.218851 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:43:30.220598 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a10f937788ef46399485d2b830a4e77a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a10f937788ef46399485d2b830a4e77a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a10f937788ef46399485d2b830a4e77a", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a10f937788ef46399485d2b830a4e77a"}]}] Jul 20 15:43:30.220598 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-VolumesGetTestJSON-1717406237 Jul 20 15:43:30.220598 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: a10f937788ef46399485d2b830a4e77a Jul 20 15:43:30.220598 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-VolumesGetTestJSON-1717406237 Jul 20 15:43:30.220598 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-VolumesGetTestJSON-1717406237-project Jul 20 15:43:30.220598 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:43:30.220598 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:43:30.220598 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: 33c3dc2a9e204e868639bd08779ea491 Jul 20 15:43:30.220598 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-VolumesGetTestJSON-1717406237-project Jul 20 15:43:30.220598 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: Jul 20 15:43:30.220598 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Volume f13f680c-afaf-4cf9-ab55-211357416693 could not be found. Jul 20 15:43:30.220598 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': 'f13f680c-afaf-4cf9-ab55-211357416693'} Jul 20 15:43:30.220598 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:43:30.221695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:30.221695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 15:43:30.221695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 15:43:30.221695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 15:43:30.221695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 15:43:30.221695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 15:43:30.221695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 15:43:30.221695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 15:43:30.221695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 15:43:30.221695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 15:43:30.221695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 15:43:30.221695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 15:43:30.221695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 15:43:30.221695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 15:43:30.221695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 15:43:30.221695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f13f680c-afaf-4cf9-ab55-211357416693 could not be found. (HTTP 404) (Request-ID: req-f8919ded-08cf-4576-a627-c5e6168e13b3) Jul 20 15:43:30.221695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:30.221695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:30.221695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:30.223344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:30.223344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 15:43:30.223344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 15:43:30.223344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 15:43:30.223344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 15:43:30.223344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 15:43:30.223344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 15:43:30.223344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 15:43:30.223344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 15:43:30.223344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 15:43:30.223344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 15:43:30.223344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 15:43:30.223344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 15:43:30.223344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 15:43:30.223344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 15:43:30.223344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 15:43:30.223344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 15:43:30.223344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 15:43:30.223344 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 15:43:30.224748 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 15:43:30.224748 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 15:43:30.224748 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 15:43:30.224748 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 15:43:30.224748 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f13f680c-afaf-4cf9-ab55-211357416693 could not be found. Jul 20 15:43:30.224748 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:30.224748 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:30.224748 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:30.224748 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:30.224748 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:30.224748 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:30.224748 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:43:30.224748 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:43:30.224748 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 15:43:30.224748 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 15:43:30.224748 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:43:30.224748 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:43:30.224748 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 15:43:30.224748 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:43:30.226446 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f13f680c-afaf-4cf9-ab55-211357416693 could not be found. Jul 20 15:43:30.226446 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:30.226446 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:30.226446 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:30.226446 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:30.226446 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:30.226446 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:30.226446 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:43:30.226446 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:43:30.226446 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f13f680c-afaf-4cf9-ab55-211357416693 could not be found. Jul 20 15:43:30.226446 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:30.226446 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-653939b3-c4c3-47b5-8fa9-b2e36b8f6ad1 tempest-VolumesGetTestJSON-1717406237 tempest-VolumesGetTestJSON-1717406237-project] Returning 404 to user: Volume f13f680c-afaf-4cf9-ab55-211357416693 could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:43:30.226446 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-653939b3-c4c3-47b5-8fa9-b2e36b8f6ad1 tempest-VolumesGetTestJSON-1717406237 tempest-VolumesGetTestJSON-1717406237-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/f13f680c-afaf-4cf9-ab55-211357416693" status: 404 len: 109 microversion: 2.1 time: 0.036280 Jul 20 15:43:30.226446 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 548/1093] 10.222.0.78 () {58 vars in 1244 bytes} [Wed Jul 20 15:43:30 2022] GET /compute/v2.1/os-volumes/f13f680c-afaf-4cf9-ab55-211357416693 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:43:32.411031 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:43:32.411789 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:43:32.539094 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-99234cf4-3704-4040-8562-ffb974eea196 tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] Action: 'create', calling method: .version_select at 0x7efd90a539d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1183787365", "metadata": {"Type": "work"}}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:43:32.565416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-99234cf4-3704-4040-8562-ffb974eea196 tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] Request method failure captured: Jul 20 15:43:32.565416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 15:43:32.565416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:43:32.565416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:43:32.565416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:43:32.565416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 122 Jul 20 15:43:32.565416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:43:32.565416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:43:32.565416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:43:32.565416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:43:32.565416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2CKkhB9dhf4zTX0HCKIpovIiCAcis7A1A-CztA6XjUnaOo4OKP2cWaaiSOSIC8bWw6McUPN1Oe4HT4cqZrrmlX0BnUxNBu7LPf_R8aE5JCcp6n1-OYYpVa8NAA6QhvnRMrezTRhbFPqO8dBFJi9Y4k4BWH7BQFYt5WXOe4dmCbt9rUc Jul 20 15:43:32.565416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:43:32.565416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:43:32.565416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:43:32.565416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:43:32.565416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:43:32.565416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:43:32.565416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: 988e25d62eb6455c9e894bebc6263fc4 Jul 20 15:43:32.565416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-VolumesNegativeTest-78116853 Jul 20 15:43:32.565416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:43:32.565416 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:43:32.567252 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/988e25d62eb6455c9e894bebc6263fc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/988e25d62eb6455c9e894bebc6263fc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_988e25d62eb6455c9e894bebc6263fc4", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/988e25d62eb6455c9e894bebc6263fc4"}]}] Jul 20 15:43:32.567252 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-VolumesNegativeTest-78116853 Jul 20 15:43:32.567252 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: 988e25d62eb6455c9e894bebc6263fc4 Jul 20 15:43:32.567252 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-VolumesNegativeTest-78116853 Jul 20 15:43:32.567252 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-VolumesNegativeTest-78116853-project Jul 20 15:43:32.567252 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:43:32.567252 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:43:32.567252 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: e1b10c7c46df4313b789b15df30cee6a Jul 20 15:43:32.567252 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-VolumesNegativeTest-78116853-project Jul 20 15:43:32.567252 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Jul 20 15:43:32.567252 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1183787365", "metadata": {"Type": "work"}}} Jul 20 15:43:32.567252 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: Jul 20 15:43:32.567252 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 15:43:32.568172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1183787365', 'metadata': {'Type': 'work'}}}} Jul 20 15:43:32.568172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:43:32.568172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:32.568172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 15:43:32.568172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 15:43:32.568172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 15:43:32.568172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise error Jul 20 15:43:32.568172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 20 15:43:32.568172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.568172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 15:43:32.568172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 15:43:32.568172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.568172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 15:43:32.568172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi '#$%' Jul 20 15:43:32.568172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.568172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:32.568172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.568172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:32.568172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:32.568172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:32.568172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:43:32.568172 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:43:32.569793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 15:43:32.569793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 15:43:32.569793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:43:32.569793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:43:32.569793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 15:43:32.569793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 15:43:32.569793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 15:43:32.569793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 15:43:32.569793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 15:43:32.569793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 15:43:32.569793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 15:43:32.569793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.569793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:32.569793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.569793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:32.569793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:32.569793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:32.569793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 15:43:32.569793 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 15:43:32.571238 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 15:43:32.571238 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.571238 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-99234cf4-3704-4040-8562-ffb974eea196 tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:43:32.571238 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-99234cf4-3704-4040-8562-ffb974eea196 tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.157537 Jul 20 15:43:32.571238 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 546/1094] 10.222.0.78 () {60 vars in 1155 bytes} [Wed Jul 20 15:43:32 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 15:43:32.575255 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:43:32.576663 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:43:32.581669 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-de3f0af0-cb63-4eb8-aeaf-c4c0ba4abffa tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] Action: 'create', calling method: .version_select at 0x7efd907f9b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1057041732", "metadata": {"Type": "work"}}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:43:32.585903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-de3f0af0-cb63-4eb8-aeaf-c4c0ba4abffa tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] Request method failure captured: Jul 20 15:43:32.585903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 15:43:32.585903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:43:32.585903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:43:32.585903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:43:32.585903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 120 Jul 20 15:43:32.585903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:43:32.585903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:43:32.585903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:43:32.585903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:43:32.585903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2CKkhB9dhf4zTX0HCKIpovIiCAcis7A1A-CztA6XjUnaOo4OKP2cWaaiSOSIC8bWw6McUPN1Oe4HT4cqZrrmlX0BnUxNBu7LPf_R8aE5JCcp6n1-OYYpVa8NAA6QhvnRMrezTRhbFPqO8dBFJi9Y4k4BWH7BQFYt5WXOe4dmCbt9rUc Jul 20 15:43:32.585903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:43:32.585903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:43:32.585903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:43:32.585903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:43:32.585903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:43:32.585903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:43:32.585903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 988e25d62eb6455c9e894bebc6263fc4 Jul 20 15:43:32.585903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-VolumesNegativeTest-78116853 Jul 20 15:43:32.585903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:43:32.585903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:43:32.588241 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/988e25d62eb6455c9e894bebc6263fc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/988e25d62eb6455c9e894bebc6263fc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_988e25d62eb6455c9e894bebc6263fc4", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/988e25d62eb6455c9e894bebc6263fc4"}]}] Jul 20 15:43:32.588241 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-VolumesNegativeTest-78116853 Jul 20 15:43:32.588241 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 988e25d62eb6455c9e894bebc6263fc4 Jul 20 15:43:32.588241 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-VolumesNegativeTest-78116853 Jul 20 15:43:32.588241 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-VolumesNegativeTest-78116853-project Jul 20 15:43:32.588241 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:43:32.588241 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:43:32.588241 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: e1b10c7c46df4313b789b15df30cee6a Jul 20 15:43:32.588241 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-VolumesNegativeTest-78116853-project Jul 20 15:43:32.588241 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Jul 20 15:43:32.588241 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1057041732", "metadata": {"Type": "work"}}} Jul 20 15:43:32.588241 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: Jul 20 15:43:32.588241 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 15:43:32.589309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1057041732', 'metadata': {'Type': 'work'}}}} Jul 20 15:43:32.589309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:43:32.589309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:32.589309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 15:43:32.589309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 15:43:32.589309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 15:43:32.589309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise error Jul 20 15:43:32.589309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 15:43:32.589309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.589309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 20 15:43:32.589309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 15:43:32.589309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.589309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 15:43:32.589309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi '0' Jul 20 15:43:32.589309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.589309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:32.589309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.589309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:32.589309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:32.589309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:32.589309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:43:32.589309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:43:32.591082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 15:43:32.591082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 15:43:32.591082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:43:32.591082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:43:32.591082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 15:43:32.591082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 15:43:32.591082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 15:43:32.591082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 15:43:32.591082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 15:43:32.591082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 15:43:32.591082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 15:43:32.591082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.591082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:32.591082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.591082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:32.591082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:32.591082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:32.591082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 15:43:32.591082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 15:43:32.592657 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 15:43:32.592657 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.592657 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-de3f0af0-cb63-4eb8-aeaf-c4c0ba4abffa tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:43:32.592657 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-de3f0af0-cb63-4eb8-aeaf-c4c0ba4abffa tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011910 Jul 20 15:43:32.592657 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 549/1095] 10.222.0.78 () {60 vars in 1155 bytes} [Wed Jul 20 15:43:32 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 15:43:32.596892 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-70f18051-35b9-41a6-b064-f5b7588aa715 tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] Action: 'create', calling method: .version_select at 0x7efd90a2a670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1750841439", "metadata": {"Type": "work"}}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:43:32.600039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-70f18051-35b9-41a6-b064-f5b7588aa715 tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] Request method failure captured: Jul 20 15:43:32.600039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 15:43:32.600039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:43:32.600039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:43:32.600039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:43:32.600039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 119 Jul 20 15:43:32.600039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:43:32.600039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:43:32.600039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:43:32.600039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:43:32.600039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2CKkhB9dhf4zTX0HCKIpovIiCAcis7A1A-CztA6XjUnaOo4OKP2cWaaiSOSIC8bWw6McUPN1Oe4HT4cqZrrmlX0BnUxNBu7LPf_R8aE5JCcp6n1-OYYpVa8NAA6QhvnRMrezTRhbFPqO8dBFJi9Y4k4BWH7BQFYt5WXOe4dmCbt9rUc Jul 20 15:43:32.600039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:43:32.600039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:43:32.600039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:43:32.600039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:43:32.600039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:43:32.600039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:43:32.600039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: 988e25d62eb6455c9e894bebc6263fc4 Jul 20 15:43:32.600039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-VolumesNegativeTest-78116853 Jul 20 15:43:32.600039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:43:32.600039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:43:32.601667 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/988e25d62eb6455c9e894bebc6263fc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/988e25d62eb6455c9e894bebc6263fc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_988e25d62eb6455c9e894bebc6263fc4", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/988e25d62eb6455c9e894bebc6263fc4"}]}] Jul 20 15:43:32.601667 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-VolumesNegativeTest-78116853 Jul 20 15:43:32.601667 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: 988e25d62eb6455c9e894bebc6263fc4 Jul 20 15:43:32.601667 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-VolumesNegativeTest-78116853 Jul 20 15:43:32.601667 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-VolumesNegativeTest-78116853-project Jul 20 15:43:32.601667 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:43:32.601667 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:43:32.601667 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: e1b10c7c46df4313b789b15df30cee6a Jul 20 15:43:32.601667 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-VolumesNegativeTest-78116853-project Jul 20 15:43:32.601667 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Jul 20 15:43:32.601667 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1750841439", "metadata": {"Type": "work"}}} Jul 20 15:43:32.601667 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: Jul 20 15:43:32.601667 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 15:43:32.602773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1750841439', 'metadata': {'Type': 'work'}}}} Jul 20 15:43:32.602773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:43:32.602773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:32.602773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 15:43:32.602773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 15:43:32.602773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 15:43:32.602773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise error Jul 20 15:43:32.602773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 20 15:43:32.602773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.602773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 15:43:32.602773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 15:43:32.602773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.602773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 15:43:32.602773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi '' Jul 20 15:43:32.602773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.602773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:32.602773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.602773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:32.602773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:32.602773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:32.602773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:43:32.602773 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:43:32.604890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 15:43:32.604890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 15:43:32.604890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:43:32.604890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:43:32.604890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 15:43:32.604890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 15:43:32.604890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 15:43:32.604890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 15:43:32.604890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 15:43:32.604890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 15:43:32.604890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 15:43:32.604890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.604890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:32.604890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.604890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:32.604890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:32.604890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:32.604890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 15:43:32.604890 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 15:43:32.606840 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 15:43:32.606840 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.606840 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-70f18051-35b9-41a6-b064-f5b7588aa715 tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:43:32.606840 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-70f18051-35b9-41a6-b064-f5b7588aa715 tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008542 Jul 20 15:43:32.606840 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 547/1096] 10.222.0.78 () {60 vars in 1155 bytes} [Wed Jul 20 15:43:32 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 15:43:32.611073 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-22b21fca-64ef-4421-b132-d1d53d0fb39d tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] Calling method '.version_select at 0x7efd90946940>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:32.639125 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-22b21fca-64ef-4421-b132-d1d53d0fb39d tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] HTTP exception thrown: Volume tempest-invalid-295378069 could not be found. Jul 20 15:43:32.641092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-22b21fca-64ef-4421-b132-d1d53d0fb39d tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] Request method failure captured: Jul 20 15:43:32.641092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-295378069 HTTP/1.1 Jul 20 15:43:32.641092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:43:32.641092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:43:32.641092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:43:32.641092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:43:32.641092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:43:32.641092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:43:32.641092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:43:32.641092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:43:32.641092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2CKkhB9dhf4zTX0HCKIpovIiCAcis7A1A-CztA6XjUnaOo4OKP2cWaaiSOSIC8bWw6McUPN1Oe4HT4cqZrrmlX0BnUxNBu7LPf_R8aE5JCcp6n1-OYYpVa8NAA6QhvnRMrezTRhbFPqO8dBFJi9Y4k4BWH7BQFYt5WXOe4dmCbt9rUc Jul 20 15:43:32.641092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:43:32.641092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:43:32.641092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:43:32.641092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:43:32.641092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:43:32.641092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:43:32.641092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 988e25d62eb6455c9e894bebc6263fc4 Jul 20 15:43:32.641092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-VolumesNegativeTest-78116853 Jul 20 15:43:32.641092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:43:32.641092 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:43:32.648884 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/988e25d62eb6455c9e894bebc6263fc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/988e25d62eb6455c9e894bebc6263fc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_988e25d62eb6455c9e894bebc6263fc4", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/988e25d62eb6455c9e894bebc6263fc4"}]}] Jul 20 15:43:32.648884 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-VolumesNegativeTest-78116853 Jul 20 15:43:32.648884 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 988e25d62eb6455c9e894bebc6263fc4 Jul 20 15:43:32.648884 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-VolumesNegativeTest-78116853 Jul 20 15:43:32.648884 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-VolumesNegativeTest-78116853-project Jul 20 15:43:32.648884 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:43:32.648884 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:43:32.648884 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: e1b10c7c46df4313b789b15df30cee6a Jul 20 15:43:32.648884 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-VolumesNegativeTest-78116853-project Jul 20 15:43:32.648884 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: Jul 20 15:43:32.648884 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Volume tempest-invalid-295378069 could not be found. Jul 20 15:43:32.648884 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': 'tempest-invalid-295378069'} Jul 20 15:43:32.648884 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:43:32.648884 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:32.650528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 15:43:32.650528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 15:43:32.650528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 15:43:32.650528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 15:43:32.650528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 15:43:32.650528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 15:43:32.650528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 15:43:32.650528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 15:43:32.650528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 15:43:32.650528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 15:43:32.650528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 15:43:32.650528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 15:43:32.650528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 15:43:32.650528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 15:43:32.650528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-295378069 could not be found. (HTTP 404) (Request-ID: req-346be5f4-2bec-4ff3-8bfa-86eed6a43b09) Jul 20 15:43:32.650528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.650528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:32.650528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.650528 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:32.651965 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 15:43:32.651965 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 15:43:32.651965 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 15:43:32.651965 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 15:43:32.651965 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 15:43:32.651965 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 15:43:32.651965 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 15:43:32.651965 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 15:43:32.651965 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 15:43:32.651965 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 15:43:32.651965 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 15:43:32.651965 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 15:43:32.651965 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 15:43:32.651965 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 15:43:32.651965 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 15:43:32.651965 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 15:43:32.651965 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 15:43:32.651965 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 15:43:32.653303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 15:43:32.653303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 15:43:32.653303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 15:43:32.653303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 15:43:32.653303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-295378069 could not be found. Jul 20 15:43:32.653303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.653303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:32.653303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.653303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:32.653303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:32.653303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:32.653303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:43:32.653303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:43:32.653303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 15:43:32.653303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 15:43:32.653303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:43:32.653303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:43:32.653303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 15:43:32.653303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:43:32.653303 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-295378069 could not be found. Jul 20 15:43:32.655097 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.655097 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:32.655097 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.655097 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:32.655097 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:32.655097 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:32.655097 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:43:32.655097 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:43:32.655097 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-295378069 could not be found. Jul 20 15:43:32.655097 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.655097 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-22b21fca-64ef-4421-b132-d1d53d0fb39d tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] Returning 404 to user: Volume tempest-invalid-295378069 could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:43:32.655097 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-22b21fca-64ef-4421-b132-d1d53d0fb39d tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/tempest-invalid-295378069" status: 404 len: 98 microversion: 2.1 time: 0.035317 Jul 20 15:43:32.655097 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 550/1097] 10.222.0.78 () {58 vars in 1214 bytes} [Wed Jul 20 15:43:32 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-295378069 => generated 98 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 15:43:32.656967 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-050ea417-0df2-462e-9dd1-e9c84e41adad tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004974 Jul 20 15:43:32.656967 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 548/1098] 10.222.0.78 () {58 vars in 1139 bytes} [Wed Jul 20 15:43:32 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 15:43:32.663652 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-cc489dec-fbd7-41b1-b93d-a27aadd9c78f tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004060 Jul 20 15:43:32.664223 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 551/1099] 10.222.0.78 () {58 vars in 1136 bytes} [Wed Jul 20 15:43:32 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 15:43:32.673314 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e7586517-c8ea-46a3-ae6e-91b26e288d37 tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] Calling method '.version_select at 0x7efd90a53ca0>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:32.702691 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-e7586517-c8ea-46a3-ae6e-91b26e288d37 tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] HTTP exception thrown: Volume d3694ca2-ecd2-4b89-8093-3d5f85b28deb could not be found. Jul 20 15:43:32.704620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e7586517-c8ea-46a3-ae6e-91b26e288d37 tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] Request method failure captured: Jul 20 15:43:32.704620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: DELETE /compute/v2.1/os-volumes/d3694ca2-ecd2-4b89-8093-3d5f85b28deb HTTP/1.1 Jul 20 15:43:32.704620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:43:32.704620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:43:32.704620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:43:32.704620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:43:32.704620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:43:32.704620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:43:32.704620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:43:32.704620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:43:32.704620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2CKkhB9dhf4zTX0HCKIpovIiCAcis7A1A-CztA6XjUnaOo4OKP2cWaaiSOSIC8bWw6McUPN1Oe4HT4cqZrrmlX0BnUxNBu7LPf_R8aE5JCcp6n1-OYYpVa8NAA6QhvnRMrezTRhbFPqO8dBFJi9Y4k4BWH7BQFYt5WXOe4dmCbt9rUc Jul 20 15:43:32.704620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:43:32.704620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:43:32.704620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:43:32.704620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:43:32.704620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:43:32.704620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:43:32.704620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: 988e25d62eb6455c9e894bebc6263fc4 Jul 20 15:43:32.704620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-VolumesNegativeTest-78116853 Jul 20 15:43:32.704620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:43:32.704620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:43:32.706333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/988e25d62eb6455c9e894bebc6263fc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/988e25d62eb6455c9e894bebc6263fc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_988e25d62eb6455c9e894bebc6263fc4", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/988e25d62eb6455c9e894bebc6263fc4"}]}] Jul 20 15:43:32.706333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-VolumesNegativeTest-78116853 Jul 20 15:43:32.706333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: 988e25d62eb6455c9e894bebc6263fc4 Jul 20 15:43:32.706333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-VolumesNegativeTest-78116853 Jul 20 15:43:32.706333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-VolumesNegativeTest-78116853-project Jul 20 15:43:32.706333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:43:32.706333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:43:32.706333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: e1b10c7c46df4313b789b15df30cee6a Jul 20 15:43:32.706333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-VolumesNegativeTest-78116853-project Jul 20 15:43:32.706333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: Jul 20 15:43:32.706333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Volume d3694ca2-ecd2-4b89-8093-3d5f85b28deb could not be found. Jul 20 15:43:32.706333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': 'd3694ca2-ecd2-4b89-8093-3d5f85b28deb'} Jul 20 15:43:32.706333 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:43:32.707380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:32.707380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 15:43:32.707380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 15:43:32.707380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 15:43:32.707380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 15:43:32.707380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 15:43:32.707380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 15:43:32.707380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 15:43:32.707380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 15:43:32.707380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 15:43:32.707380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 15:43:32.707380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 15:43:32.707380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 15:43:32.707380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 15:43:32.707380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 15:43:32.707380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d3694ca2-ecd2-4b89-8093-3d5f85b28deb could not be found. (HTTP 404) (Request-ID: req-589da89a-8234-418c-9fa4-65ab065263ef) Jul 20 15:43:32.707380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.707380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:32.707380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.708815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:32.708815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 15:43:32.708815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 15:43:32.708815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 15:43:32.708815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 15:43:32.708815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 15:43:32.708815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 15:43:32.708815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 15:43:32.708815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 15:43:32.708815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 15:43:32.708815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 15:43:32.708815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 15:43:32.708815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 15:43:32.708815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 15:43:32.708815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 15:43:32.708815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 15:43:32.708815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 15:43:32.708815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 15:43:32.708815 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 15:43:32.710457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 15:43:32.710457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 15:43:32.710457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 15:43:32.710457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 15:43:32.710457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d3694ca2-ecd2-4b89-8093-3d5f85b28deb could not be found. Jul 20 15:43:32.710457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.710457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:32.710457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.710457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:32.710457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:32.710457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:32.710457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:43:32.710457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:43:32.710457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 15:43:32.710457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 15:43:32.710457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:43:32.710457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:43:32.710457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 15:43:32.710457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:43:32.711977 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d3694ca2-ecd2-4b89-8093-3d5f85b28deb could not be found. Jul 20 15:43:32.711977 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.711977 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:32.711977 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.711977 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:32.711977 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:32.711977 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:32.711977 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:43:32.711977 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:43:32.711977 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d3694ca2-ecd2-4b89-8093-3d5f85b28deb could not be found. Jul 20 15:43:32.711977 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.711977 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e7586517-c8ea-46a3-ae6e-91b26e288d37 tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] Returning 404 to user: Volume d3694ca2-ecd2-4b89-8093-3d5f85b28deb could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:43:32.711977 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e7586517-c8ea-46a3-ae6e-91b26e288d37 tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/d3694ca2-ecd2-4b89-8093-3d5f85b28deb" status: 404 len: 109 microversion: 2.1 time: 0.036617 Jul 20 15:43:32.711977 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 549/1100] 10.222.0.78 () {58 vars in 1247 bytes} [Wed Jul 20 15:43:32 2022] DELETE /compute/v2.1/os-volumes/d3694ca2-ecd2-4b89-8093-3d5f85b28deb => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:43:32.718368 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-02e521c1-6f69-432d-8eef-c82490dbeac2 tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] Calling method '.version_select at 0x7efd90946430>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:32.750815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-02e521c1-6f69-432d-8eef-c82490dbeac2 tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] HTTP exception thrown: Volume 7c330cc2-b96f-479b-9e03-501d66a0f69b could not be found. Jul 20 15:43:32.750815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-02e521c1-6f69-432d-8eef-c82490dbeac2 tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] Request method failure captured: Jul 20 15:43:32.750815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: GET /compute/v2.1/os-volumes/7c330cc2-b96f-479b-9e03-501d66a0f69b HTTP/1.1 Jul 20 15:43:32.750815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:43:32.750815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:43:32.750815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:43:32.750815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:43:32.750815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:43:32.750815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:43:32.750815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:43:32.750815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:43:32.750815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2CKkhB9dhf4zTX0HCKIpovIiCAcis7A1A-CztA6XjUnaOo4OKP2cWaaiSOSIC8bWw6McUPN1Oe4HT4cqZrrmlX0BnUxNBu7LPf_R8aE5JCcp6n1-OYYpVa8NAA6QhvnRMrezTRhbFPqO8dBFJi9Y4k4BWH7BQFYt5WXOe4dmCbt9rUc Jul 20 15:43:32.750815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:43:32.750815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:43:32.750815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:43:32.750815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:43:32.750815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:43:32.750815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:43:32.750815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 988e25d62eb6455c9e894bebc6263fc4 Jul 20 15:43:32.750815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-VolumesNegativeTest-78116853 Jul 20 15:43:32.750815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:43:32.750815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:43:32.752397 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/988e25d62eb6455c9e894bebc6263fc4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/988e25d62eb6455c9e894bebc6263fc4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_988e25d62eb6455c9e894bebc6263fc4", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/988e25d62eb6455c9e894bebc6263fc4"}]}] Jul 20 15:43:32.752397 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-VolumesNegativeTest-78116853 Jul 20 15:43:32.752397 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 988e25d62eb6455c9e894bebc6263fc4 Jul 20 15:43:32.752397 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-VolumesNegativeTest-78116853 Jul 20 15:43:32.752397 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-VolumesNegativeTest-78116853-project Jul 20 15:43:32.752397 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:43:32.752397 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:43:32.752397 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: e1b10c7c46df4313b789b15df30cee6a Jul 20 15:43:32.752397 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-VolumesNegativeTest-78116853-project Jul 20 15:43:32.752397 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: Jul 20 15:43:32.752397 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Volume 7c330cc2-b96f-479b-9e03-501d66a0f69b could not be found. Jul 20 15:43:32.752397 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': '7c330cc2-b96f-479b-9e03-501d66a0f69b'} Jul 20 15:43:32.752397 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:43:32.753280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:32.753280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 15:43:32.753280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 15:43:32.753280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 15:43:32.753280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 15:43:32.753280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 15:43:32.753280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 15:43:32.753280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 15:43:32.753280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 15:43:32.753280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 15:43:32.753280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 15:43:32.753280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 15:43:32.753280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 15:43:32.753280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 15:43:32.753280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 15:43:32.753280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7c330cc2-b96f-479b-9e03-501d66a0f69b could not be found. (HTTP 404) (Request-ID: req-6fc73748-a13a-4336-b743-f44d3efecd1f) Jul 20 15:43:32.753280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.753280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:32.753280 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.754522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:32.754522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 15:43:32.754522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 15:43:32.754522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 15:43:32.754522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 15:43:32.754522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 15:43:32.754522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 15:43:32.754522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 15:43:32.754522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 15:43:32.754522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 15:43:32.754522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 15:43:32.754522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 15:43:32.754522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 15:43:32.754522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 15:43:32.754522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 15:43:32.754522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 15:43:32.754522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 15:43:32.754522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 15:43:32.754522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 15:43:32.755888 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 15:43:32.755888 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 15:43:32.755888 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 15:43:32.755888 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 15:43:32.755888 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7c330cc2-b96f-479b-9e03-501d66a0f69b could not be found. Jul 20 15:43:32.755888 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.755888 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:32.755888 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.755888 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:32.755888 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:32.755888 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:32.755888 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:43:32.755888 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:43:32.755888 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 15:43:32.755888 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 15:43:32.755888 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:43:32.755888 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:43:32.755888 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 15:43:32.755888 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:43:32.757390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7c330cc2-b96f-479b-9e03-501d66a0f69b could not be found. Jul 20 15:43:32.757390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.757390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:43:32.757390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.757390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:43:32.757390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:43:32.757390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:43:32.757390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:43:32.757390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:43:32.757390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7c330cc2-b96f-479b-9e03-501d66a0f69b could not be found. Jul 20 15:43:32.757390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:43:32.757390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-02e521c1-6f69-432d-8eef-c82490dbeac2 tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] Returning 404 to user: Volume 7c330cc2-b96f-479b-9e03-501d66a0f69b could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:43:32.757390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-02e521c1-6f69-432d-8eef-c82490dbeac2 tempest-VolumesNegativeTest-78116853 tempest-VolumesNegativeTest-78116853-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/7c330cc2-b96f-479b-9e03-501d66a0f69b" status: 404 len: 109 microversion: 2.1 time: 0.037143 Jul 20 15:43:32.757390 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 552/1101] 10.222.0.78 () {58 vars in 1244 bytes} [Wed Jul 20 15:43:32 2022] GET /compute/v2.1/os-volumes/7c330cc2-b96f-479b-9e03-501d66a0f69b => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:43:52.356418 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c626b937-82c7-4d76-ab05-85f1b01eb2b3 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2003621233", "imageRef": "80914b1c-623c-42a8-810e-836b2cce0d3b", "flavorRef": "452"}} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:43:52.407768 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.network.neutron [None req-c626b937-82c7-4d76-ab05-85f1b01eb2b3 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] validate_networks() for None {{(pid=124711) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 15:43:52.694228 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-c626b937-82c7-4d76-ab05-85f1b01eb2b3 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Flavor limits 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 15:43:52.694702 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-c626b937-82c7-4d76-ab05-85f1b01eb2b3 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Image limits 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 15:43:52.695220 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-c626b937-82c7-4d76-ab05-85f1b01eb2b3 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Flavor pref 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 15:43:52.695626 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-c626b937-82c7-4d76-ab05-85f1b01eb2b3 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Image pref 0:0:0 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 15:43:52.696566 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.virt.hardware [None req-c626b937-82c7-4d76-ab05-85f1b01eb2b3 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124711) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 15:43:52.705598 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c626b937-82c7-4d76-ab05-85f1b01eb2b3 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:52.706041 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c626b937-82c7-4d76-ab05-85f1b01eb2b3 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:52.706885 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c626b937-82c7-4d76-ab05-85f1b01eb2b3 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:52.707318 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c626b937-82c7-4d76-ab05-85f1b01eb2b3 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:52.723781 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-c626b937-82c7-4d76-ab05-85f1b01eb2b3 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Getting quotas for project 14078d32fe294b2784fb0521b57db424. Resources: {'instances', 'ram', 'cores'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:43:52.727684 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.quota [None req-c626b937-82c7-4d76-ab05-85f1b01eb2b3 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Getting quotas for user c72bddf22f6842a2bda756cf1a3a1573 and project 14078d32fe294b2784fb0521b57db424. Resources: {'instances', 'ram', 'cores'} {{(pid=124711) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:43:52.738542 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c626b937-82c7-4d76-ab05-85f1b01eb2b3 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Going to run 1 instances... {{(pid=124711) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 15:43:52.740764 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c626b937-82c7-4d76-ab05-85f1b01eb2b3 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] [instance: 3ed67155-4ccd-4591-8241-743febd841ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='80914b1c-623c-42a8-810e-836b2cce0d3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124711) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 15:43:52.909700 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c626b937-82c7-4d76-ab05-85f1b01eb2b3 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.558921 Jul 20 15:43:52.910283 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 550/1102] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Jul 20 15:43:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 560 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 15:43:52.921958 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-f9ab5174-3902-46e5-b393-34829b87bb17 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:52.922593 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-f9ab5174-3902-46e5-b393-34829b87bb17 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] [instance: 3ed67155-4ccd-4591-8241-743febd841ad] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:52.982130 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-f9ab5174-3902-46e5-b393-34829b87bb17 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72bddf22f6842a2bda756cf1a3a1573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14078d32fe294b2784fb0521b57db424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:43:52.988978 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-f9ab5174-3902-46e5-b393-34829b87bb17 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] 10.222.0.78 "GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad" status: 200 len: 1215 microversion: 2.1 time: 0.072198 Jul 20 15:43:52.989555 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 553/1103] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:43:52 2022] GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:43:54.006650 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-0000498b-c0cf-4549-8de4-fd2307664631 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:54.007267 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-0000498b-c0cf-4549-8de4-fd2307664631 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] [instance: 3ed67155-4ccd-4591-8241-743febd841ad] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:54.063639 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-0000498b-c0cf-4549-8de4-fd2307664631 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72bddf22f6842a2bda756cf1a3a1573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14078d32fe294b2784fb0521b57db424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:43:54.071356 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-0000498b-c0cf-4549-8de4-fd2307664631 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] 10.222.0.78 "GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad" status: 200 len: 1215 microversion: 2.1 time: 0.068419 Jul 20 15:43:54.071921 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 551/1104] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:43:54 2022] GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:43:55.094662 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-781ab250-e12c-4952-b63c-2a8024baa457 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:55.095464 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-781ab250-e12c-4952-b63c-2a8024baa457 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] [instance: 3ed67155-4ccd-4591-8241-743febd841ad] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:55.102019 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-781ab250-e12c-4952-b63c-2a8024baa457 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:55.102498 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-781ab250-e12c-4952-b63c-2a8024baa457 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:55.103325 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-781ab250-e12c-4952-b63c-2a8024baa457 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:55.103766 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-781ab250-e12c-4952-b63c-2a8024baa457 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:55.165264 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-781ab250-e12c-4952-b63c-2a8024baa457 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72bddf22f6842a2bda756cf1a3a1573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14078d32fe294b2784fb0521b57db424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:43:55.173043 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-781ab250-e12c-4952-b63c-2a8024baa457 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] 10.222.0.78 "GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad" status: 200 len: 1267 microversion: 2.1 time: 0.082793 Jul 20 15:43:55.173660 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 554/1105] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:43:55 2022] GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad => generated 1267 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:43:56.190340 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d8c01117-2025-46ed-8cd3-d59710ed98db tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:56.190863 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-d8c01117-2025-46ed-8cd3-d59710ed98db tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] [instance: 3ed67155-4ccd-4591-8241-743febd841ad] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:56.198501 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d8c01117-2025-46ed-8cd3-d59710ed98db tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:56.199310 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d8c01117-2025-46ed-8cd3-d59710ed98db tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:56.199714 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d8c01117-2025-46ed-8cd3-d59710ed98db tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:56.200150 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d8c01117-2025-46ed-8cd3-d59710ed98db tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:56.263708 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d8c01117-2025-46ed-8cd3-d59710ed98db tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72bddf22f6842a2bda756cf1a3a1573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14078d32fe294b2784fb0521b57db424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:43:56.272593 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d8c01117-2025-46ed-8cd3-d59710ed98db tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] 10.222.0.78 "GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad" status: 200 len: 1273 microversion: 2.1 time: 0.086246 Jul 20 15:43:56.273187 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 552/1106] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:43:56 2022] GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:43:57.291430 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-db9f8b59-f72e-4e60-97cf-e960fcdeee7c tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:57.292053 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-db9f8b59-f72e-4e60-97cf-e960fcdeee7c tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] [instance: 3ed67155-4ccd-4591-8241-743febd841ad] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:57.298844 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-db9f8b59-f72e-4e60-97cf-e960fcdeee7c tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:57.302221 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-db9f8b59-f72e-4e60-97cf-e960fcdeee7c tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:57.302221 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-db9f8b59-f72e-4e60-97cf-e960fcdeee7c tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:57.302221 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-db9f8b59-f72e-4e60-97cf-e960fcdeee7c tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:57.443404 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-db9f8b59-f72e-4e60-97cf-e960fcdeee7c tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72bddf22f6842a2bda756cf1a3a1573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14078d32fe294b2784fb0521b57db424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:43:57.453885 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-db9f8b59-f72e-4e60-97cf-e960fcdeee7c tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] 10.222.0.78 "GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad" status: 200 len: 1315 microversion: 2.1 time: 0.167011 Jul 20 15:43:57.464463 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 555/1107] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:43:57 2022] GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:43:57.643986 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-1794dd4f-a28c-48f1-a26a-5646b4c0c149 req-62ddc4e9-352d-4292-a17d-a9f5a8d532e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed67155-4ccd-4591-8241-743febd841ad", "tag": "777cfc94-3204-4f4f-9e21-222364e5df97"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:43:57.653974 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-1794dd4f-a28c-48f1-a26a-5646b4c0c149 req-62ddc4e9-352d-4292-a17d-a9f5a8d532e3 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:57.654577 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-1794dd4f-a28c-48f1-a26a-5646b4c0c149 req-62ddc4e9-352d-4292-a17d-a9f5a8d532e3 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:57.668517 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-1794dd4f-a28c-48f1-a26a-5646b4c0c149 req-62ddc4e9-352d-4292-a17d-a9f5a8d532e3 service nova] Creating event network-changed:777cfc94-3204-4f4f-9e21-222364e5df97 for instance 3ed67155-4ccd-4591-8241-743febd841ad on hv-cinder-81914 Jul 20 15:43:57.674082 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-1794dd4f-a28c-48f1-a26a-5646b4c0c149 req-62ddc4e9-352d-4292-a17d-a9f5a8d532e3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035659 Jul 20 15:43:57.675363 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 553/1108] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:43:58.471405 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-66fc3c99-6b7d-4df3-a0c7-33250b132d31 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:58.472013 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-66fc3c99-6b7d-4df3-a0c7-33250b132d31 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] [instance: 3ed67155-4ccd-4591-8241-743febd841ad] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:58.478371 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-66fc3c99-6b7d-4df3-a0c7-33250b132d31 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:58.478847 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-66fc3c99-6b7d-4df3-a0c7-33250b132d31 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:58.479639 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-66fc3c99-6b7d-4df3-a0c7-33250b132d31 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:58.480098 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-66fc3c99-6b7d-4df3-a0c7-33250b132d31 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:58.611028 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-66fc3c99-6b7d-4df3-a0c7-33250b132d31 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72bddf22f6842a2bda756cf1a3a1573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14078d32fe294b2784fb0521b57db424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:43:58.619221 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-66fc3c99-6b7d-4df3-a0c7-33250b132d31 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] 10.222.0.78 "GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad" status: 200 len: 1315 microversion: 2.1 time: 0.151804 Jul 20 15:43:58.619793 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 556/1109] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:43:58 2022] GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:43:59.637154 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-1b89fa02-7bc8-4ace-8b3a-4148e954c056 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:43:59.637842 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-1b89fa02-7bc8-4ace-8b3a-4148e954c056 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] [instance: 3ed67155-4ccd-4591-8241-743febd841ad] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:43:59.645207 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1b89fa02-7bc8-4ace-8b3a-4148e954c056 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:59.645650 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1b89fa02-7bc8-4ace-8b3a-4148e954c056 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:59.646438 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1b89fa02-7bc8-4ace-8b3a-4148e954c056 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:43:59.646869 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1b89fa02-7bc8-4ace-8b3a-4148e954c056 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:43:59.781186 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-1b89fa02-7bc8-4ace-8b3a-4148e954c056 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72bddf22f6842a2bda756cf1a3a1573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14078d32fe294b2784fb0521b57db424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:43:59.788740 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-1b89fa02-7bc8-4ace-8b3a-4148e954c056 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] 10.222.0.78 "GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad" status: 200 len: 1315 microversion: 2.1 time: 0.156096 Jul 20 15:43:59.789818 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 554/1110] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:43:59 2022] GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:00.806047 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-d3e51c42-2ce9-4163-8b41-0435573c4a51 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:00.806787 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-d3e51c42-2ce9-4163-8b41-0435573c4a51 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] [instance: 3ed67155-4ccd-4591-8241-743febd841ad] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:00.813928 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d3e51c42-2ce9-4163-8b41-0435573c4a51 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:00.816906 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d3e51c42-2ce9-4163-8b41-0435573c4a51 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:00.816906 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d3e51c42-2ce9-4163-8b41-0435573c4a51 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:00.816906 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-d3e51c42-2ce9-4163-8b41-0435573c4a51 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:00.957826 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-d3e51c42-2ce9-4163-8b41-0435573c4a51 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72bddf22f6842a2bda756cf1a3a1573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14078d32fe294b2784fb0521b57db424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:00.965953 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-d3e51c42-2ce9-4163-8b41-0435573c4a51 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] 10.222.0.78 "GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad" status: 200 len: 1315 microversion: 2.1 time: 0.164617 Jul 20 15:44:00.966544 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 557/1111] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:00 2022] GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:01.982872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-f02a1db7-a37b-4ec6-b11f-6906ccd69727 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:01.983521 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-f02a1db7-a37b-4ec6-b11f-6906ccd69727 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] [instance: 3ed67155-4ccd-4591-8241-743febd841ad] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:01.989935 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f02a1db7-a37b-4ec6-b11f-6906ccd69727 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:01.990413 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f02a1db7-a37b-4ec6-b11f-6906ccd69727 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:01.991168 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f02a1db7-a37b-4ec6-b11f-6906ccd69727 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:01.991598 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-f02a1db7-a37b-4ec6-b11f-6906ccd69727 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:02.125553 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-f02a1db7-a37b-4ec6-b11f-6906ccd69727 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72bddf22f6842a2bda756cf1a3a1573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14078d32fe294b2784fb0521b57db424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:02.134065 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-f02a1db7-a37b-4ec6-b11f-6906ccd69727 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] 10.222.0.78 "GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad" status: 200 len: 1315 microversion: 2.1 time: 0.155112 Jul 20 15:44:02.134684 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 555/1112] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:01 2022] GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:02.809001 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-d1b99387-6f22-465d-aade-f14af6aba07e req-ebcdabb3-3d33-4f1f-aeb6-e06eaa8aac76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed67155-4ccd-4591-8241-743febd841ad", "name": "network-vif-plugged", "status": "completed", "tag": "777cfc94-3204-4f4f-9e21-222364e5df97"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:44:02.817863 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-d1b99387-6f22-465d-aade-f14af6aba07e req-ebcdabb3-3d33-4f1f-aeb6-e06eaa8aac76 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:02.818334 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-d1b99387-6f22-465d-aade-f14af6aba07e req-ebcdabb3-3d33-4f1f-aeb6-e06eaa8aac76 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:02.830807 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-d1b99387-6f22-465d-aade-f14af6aba07e req-ebcdabb3-3d33-4f1f-aeb6-e06eaa8aac76 service nova] Creating event network-vif-plugged:777cfc94-3204-4f4f-9e21-222364e5df97 for instance 3ed67155-4ccd-4591-8241-743febd841ad on hv-cinder-81914 Jul 20 15:44:02.836701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-d1b99387-6f22-465d-aade-f14af6aba07e req-ebcdabb3-3d33-4f1f-aeb6-e06eaa8aac76 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154506 Jul 20 15:44:02.838998 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 558/1113] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:44:03.151570 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-633a2df4-e444-44cf-93e0-6caeb5e051de tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:03.152200 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-633a2df4-e444-44cf-93e0-6caeb5e051de tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] [instance: 3ed67155-4ccd-4591-8241-743febd841ad] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:03.154129 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=2 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:44:03.159407 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-633a2df4-e444-44cf-93e0-6caeb5e051de tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:03.159848 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-633a2df4-e444-44cf-93e0-6caeb5e051de tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:03.160818 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-633a2df4-e444-44cf-93e0-6caeb5e051de tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:03.161251 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-633a2df4-e444-44cf-93e0-6caeb5e051de tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:03.300202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-633a2df4-e444-44cf-93e0-6caeb5e051de tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72bddf22f6842a2bda756cf1a3a1573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14078d32fe294b2784fb0521b57db424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:03.307872 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-633a2df4-e444-44cf-93e0-6caeb5e051de tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] 10.222.0.78 "GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad" status: 200 len: 1315 microversion: 2.1 time: 0.160655 Jul 20 15:44:03.308453 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 556/1114] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:03 2022] GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:04.324574 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-78e7a015-58dd-4739-961f-f2fcb23b5be2 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:04.325261 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-78e7a015-58dd-4739-961f-f2fcb23b5be2 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] [instance: 3ed67155-4ccd-4591-8241-743febd841ad] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:04.327265 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=2 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:44:04.332883 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-78e7a015-58dd-4739-961f-f2fcb23b5be2 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:04.333326 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-78e7a015-58dd-4739-961f-f2fcb23b5be2 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:04.334084 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-78e7a015-58dd-4739-961f-f2fcb23b5be2 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:04.334544 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-78e7a015-58dd-4739-961f-f2fcb23b5be2 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:04.470002 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-78e7a015-58dd-4739-961f-f2fcb23b5be2 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72bddf22f6842a2bda756cf1a3a1573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14078d32fe294b2784fb0521b57db424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:04.478008 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-78e7a015-58dd-4739-961f-f2fcb23b5be2 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] 10.222.0.78 "GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad" status: 200 len: 1464 microversion: 2.1 time: 0.157869 Jul 20 15:44:04.478608 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 559/1115] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:04 2022] GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad => generated 1464 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:04.524926 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e9759f54-9ae6-4d52-a419-f1f2f96db4b9 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:04.531645 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e9759f54-9ae6-4d52-a419-f1f2f96db4b9 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] [instance: 3ed67155-4ccd-4591-8241-743febd841ad] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:04.531645 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=8 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:44:04.532739 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e9759f54-9ae6-4d52-a419-f1f2f96db4b9 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:04.533180 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e9759f54-9ae6-4d52-a419-f1f2f96db4b9 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:04.533932 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e9759f54-9ae6-4d52-a419-f1f2f96db4b9 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:04.534390 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e9759f54-9ae6-4d52-a419-f1f2f96db4b9 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:04.560086 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e9759f54-9ae6-4d52-a419-f1f2f96db4b9 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] [instance: 3ed67155-4ccd-4591-8241-743febd841ad] Going to try to terminate instance {{(pid=124711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 15:44:05.011457 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e9759f54-9ae6-4d52-a419-f1f2f96db4b9 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad" status: 204 len: 0 microversion: 2.1 time: 0.490776 Jul 20 15:44:05.012054 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 557/1116] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:44:04 2022] DELETE /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 15:44:05.021176 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-611a8d10-c5a7-4ffe-8378-0407c3c3312a tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:05.021783 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-611a8d10-c5a7-4ffe-8378-0407c3c3312a tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] [instance: 3ed67155-4ccd-4591-8241-743febd841ad] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:05.028714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-611a8d10-c5a7-4ffe-8378-0407c3c3312a tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:05.029156 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-611a8d10-c5a7-4ffe-8378-0407c3c3312a tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:05.029907 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-611a8d10-c5a7-4ffe-8378-0407c3c3312a tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:05.030382 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-611a8d10-c5a7-4ffe-8378-0407c3c3312a tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:05.168805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-611a8d10-c5a7-4ffe-8378-0407c3c3312a tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72bddf22f6842a2bda756cf1a3a1573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14078d32fe294b2784fb0521b57db424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:05.176527 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-611a8d10-c5a7-4ffe-8378-0407c3c3312a tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] 10.222.0.78 "GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad" status: 200 len: 1470 microversion: 2.1 time: 0.159305 Jul 20 15:44:05.177101 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 560/1117] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:05 2022] GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:06.194777 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5e57cc55-e56f-4534-aac2-4cf5462caa08 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:06.195487 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5e57cc55-e56f-4534-aac2-4cf5462caa08 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] [instance: 3ed67155-4ccd-4591-8241-743febd841ad] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:06.203036 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e57cc55-e56f-4534-aac2-4cf5462caa08 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:06.203480 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e57cc55-e56f-4534-aac2-4cf5462caa08 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:06.204231 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e57cc55-e56f-4534-aac2-4cf5462caa08 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:06.204657 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5e57cc55-e56f-4534-aac2-4cf5462caa08 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:06.340443 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5e57cc55-e56f-4534-aac2-4cf5462caa08 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72bddf22f6842a2bda756cf1a3a1573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14078d32fe294b2784fb0521b57db424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:06.348179 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5e57cc55-e56f-4534-aac2-4cf5462caa08 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] 10.222.0.78 "GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad" status: 200 len: 1470 microversion: 2.1 time: 0.157692 Jul 20 15:44:06.348958 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 558/1118] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:06 2022] GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:06.909405 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-5937b185-3ebb-4442-a76d-104cdcc6745b req-9342ff2b-1f30-4c58-9002-a8bed25306c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed67155-4ccd-4591-8241-743febd841ad", "name": "network-vif-deleted", "tag": "777cfc94-3204-4f4f-9e21-222364e5df97"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:44:06.918655 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-5937b185-3ebb-4442-a76d-104cdcc6745b req-9342ff2b-1f30-4c58-9002-a8bed25306c8 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:06.919098 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-5937b185-3ebb-4442-a76d-104cdcc6745b req-9342ff2b-1f30-4c58-9002-a8bed25306c8 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:06.931188 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-5937b185-3ebb-4442-a76d-104cdcc6745b req-9342ff2b-1f30-4c58-9002-a8bed25306c8 service nova] Creating event network-vif-deleted:777cfc94-3204-4f4f-9e21-222364e5df97 for instance 3ed67155-4ccd-4591-8241-743febd841ad on hv-cinder-81914 Jul 20 15:44:06.935959 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-5937b185-3ebb-4442-a76d-104cdcc6745b req-9342ff2b-1f30-4c58-9002-a8bed25306c8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030483 Jul 20 15:44:06.936569 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 561/1119] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:44:07.366611 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e0310083-6192-4d07-a600-a00e27734f2a tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:07.367157 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e0310083-6192-4d07-a600-a00e27734f2a tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] [instance: 3ed67155-4ccd-4591-8241-743febd841ad] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:07.375556 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e0310083-6192-4d07-a600-a00e27734f2a tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:07.376010 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e0310083-6192-4d07-a600-a00e27734f2a tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:07.377641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e0310083-6192-4d07-a600-a00e27734f2a tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:07.377641 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e0310083-6192-4d07-a600-a00e27734f2a tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:07.407360 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e0310083-6192-4d07-a600-a00e27734f2a tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:07.407805 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e0310083-6192-4d07-a600-a00e27734f2a tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:07.408249 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.objects.instance [None req-e0310083-6192-4d07-a600-a00e27734f2a tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lazy-loading 'fault' on Instance uuid 3ed67155-4ccd-4591-8241-743febd841ad {{(pid=124711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:44:07.449449 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e0310083-6192-4d07-a600-a00e27734f2a tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72bddf22f6842a2bda756cf1a3a1573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14078d32fe294b2784fb0521b57db424', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:07.456853 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e0310083-6192-4d07-a600-a00e27734f2a tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] 10.222.0.78 "GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad" status: 200 len: 1305 microversion: 2.1 time: 0.094245 Jul 20 15:44:07.457594 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 559/1120] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:07 2022] GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:08.475817 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-72c638f2-a6ff-41ab-b5ac-03483b4093f9 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:08.476444 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-72c638f2-a6ff-41ab-b5ac-03483b4093f9 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] [instance: 3ed67155-4ccd-4591-8241-743febd841ad] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:08.483822 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-72c638f2-a6ff-41ab-b5ac-03483b4093f9 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:08.484319 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-72c638f2-a6ff-41ab-b5ac-03483b4093f9 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:08.485139 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-72c638f2-a6ff-41ab-b5ac-03483b4093f9 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:08.485616 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-72c638f2-a6ff-41ab-b5ac-03483b4093f9 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:08.499660 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-72c638f2-a6ff-41ab-b5ac-03483b4093f9 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] HTTP exception thrown: Instance 3ed67155-4ccd-4591-8241-743febd841ad could not be found. Jul 20 15:44:08.501316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-72c638f2-a6ff-41ab-b5ac-03483b4093f9 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Request method failure captured: Jul 20 15:44:08.501316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad HTTP/1.1 Jul 20 15:44:08.501316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:44:08.501316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:44:08.501316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:44:08.501316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:44:08.501316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:44:08.501316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:44:08.501316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:44:08.501316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:44:08.501316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2CK2RSYpV6Z78XomHN9AaWyJzNMJrT_70XOlpVc--CL4AjZ-A2jETIAQ8ZLR4X1B_fCk2Aajd1MpLGunXZOHdwiSaRZ4meORNWH-ougrNhZWNzqa2p5X2j6-UFMDPt_aLj98gcNk88d2nBpk52OVGTTPK8CjUC3hJinGkw5-U8eagZA Jul 20 15:44:08.501316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:44:08.501316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:44:08.501316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:44:08.501316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:44:08.501316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:44:08.501316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:44:08.501316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 14078d32fe294b2784fb0521b57db424 Jul 20 15:44:08.501316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-VolumesNegativeTest-1889673476 Jul 20 15:44:08.501316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:44:08.501316 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:44:08.503077 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/14078d32fe294b2784fb0521b57db424"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/14078d32fe294b2784fb0521b57db424"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_14078d32fe294b2784fb0521b57db424", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/14078d32fe294b2784fb0521b57db424"}]}] Jul 20 15:44:08.503077 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-VolumesNegativeTest-1889673476 Jul 20 15:44:08.503077 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 14078d32fe294b2784fb0521b57db424 Jul 20 15:44:08.503077 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-VolumesNegativeTest-1889673476 Jul 20 15:44:08.503077 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-VolumesNegativeTest-1889673476-project Jul 20 15:44:08.503077 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:44:08.503077 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:44:08.503077 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: c72bddf22f6842a2bda756cf1a3a1573 Jul 20 15:44:08.503077 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-VolumesNegativeTest-1889673476-project Jul 20 15:44:08.503077 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:44:08.503077 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance 3ed67155-4ccd-4591-8241-743febd841ad could not be found. Jul 20 15:44:08.503077 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': '3ed67155-4ccd-4591-8241-743febd841ad'} Jul 20 15:44:08.504105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:44:08.504105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:44:08.504105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:44:08.504105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:44:08.504105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:44:08.504105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:44:08.504105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:44:08.504105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:44:08.504105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:44:08.504105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:44:08.504105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ed67155-4ccd-4591-8241-743febd841ad could not be found. Jul 20 15:44:08.504105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:44:08.504105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:44:08.504105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:44:08.504105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:44:08.504105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:44:08.504105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:44:08.504105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:44:08.504105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:44:08.504105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:44:08.505701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:44:08.505701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:44:08.505701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:44:08.505701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:44:08.505701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:44:08.505701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:44:08.505701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:44:08.505701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed67155-4ccd-4591-8241-743febd841ad could not be found. Jul 20 15:44:08.505701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:44:08.505701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:44:08.505701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:44:08.505701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:44:08.505701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:44:08.505701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:44:08.505701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:44:08.505701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:44:08.505701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed67155-4ccd-4591-8241-743febd841ad could not be found. Jul 20 15:44:08.505701 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:44:08.509084 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-72c638f2-a6ff-41ab-b5ac-03483b4093f9 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] Returning 404 to user: Instance 3ed67155-4ccd-4591-8241-743febd841ad could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:44:08.509084 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-72c638f2-a6ff-41ab-b5ac-03483b4093f9 tempest-VolumesNegativeTest-1889673476 tempest-VolumesNegativeTest-1889673476-project] 10.222.0.78 "GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad" status: 404 len: 111 microversion: 2.1 time: 0.031780 Jul 20 15:44:08.509084 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 562/1121] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:08 2022] GET /compute/v2.1/servers/3ed67155-4ccd-4591-8241-743febd841ad => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:44:32.481204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-67235cb6-189c-4b01-9ae1-4821c4a4c5ca tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:32.481829 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-67235cb6-189c-4b01-9ae1-4821c4a4c5ca tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:32.484086 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:44:32.484734 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:44:32.490417 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-67235cb6-189c-4b01-9ae1-4821c4a4c5ca tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:32.490859 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-67235cb6-189c-4b01-9ae1-4821c4a4c5ca tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:32.491613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-67235cb6-189c-4b01-9ae1-4821c4a4c5ca tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:32.492047 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-67235cb6-189c-4b01-9ae1-4821c4a4c5ca tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:32.517349 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-67235cb6-189c-4b01-9ae1-4821c4a4c5ca tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Going to try to terminate instance {{(pid=124711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 15:44:32.892934 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-67235cb6-189c-4b01-9ae1-4821c4a4c5ca tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 204 len: 0 microversion: 2.1 time: 0.415292 Jul 20 15:44:32.893551 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 560/1122] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:44:32 2022] DELETE /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 15:44:32.902551 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-87472939-b65e-436d-99ba-7156f3e84e9d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:32.910703 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-87472939-b65e-436d-99ba-7156f3e84e9d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:32.910703 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=22 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:44:32.910703 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=42 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:44:32.910703 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-87472939-b65e-436d-99ba-7156f3e84e9d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:32.911155 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-87472939-b65e-436d-99ba-7156f3e84e9d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:32.911899 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-87472939-b65e-436d-99ba-7156f3e84e9d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:32.912329 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-87472939-b65e-436d-99ba-7156f3e84e9d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:33.050350 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-87472939-b65e-436d-99ba-7156f3e84e9d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:33.058389 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-87472939-b65e-436d-99ba-7156f3e84e9d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1578 microversion: 2.1 time: 0.160577 Jul 20 15:44:33.058970 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 563/1123] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:32 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:34.077657 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-1c84ba4b-8b6d-4093-981f-71afa442ab7c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:34.078431 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-1c84ba4b-8b6d-4093-981f-71afa442ab7c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:34.085985 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1c84ba4b-8b6d-4093-981f-71afa442ab7c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:34.086458 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1c84ba4b-8b6d-4093-981f-71afa442ab7c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:34.087231 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1c84ba4b-8b6d-4093-981f-71afa442ab7c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:34.087714 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-1c84ba4b-8b6d-4093-981f-71afa442ab7c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:34.223994 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-1c84ba4b-8b6d-4093-981f-71afa442ab7c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:34.232024 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-1c84ba4b-8b6d-4093-981f-71afa442ab7c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1578 microversion: 2.1 time: 0.158715 Jul 20 15:44:34.232588 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 561/1124] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:34 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:35.249584 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b8faaa0b-7dbb-489c-a698-38018574fed8 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:35.256153 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b8faaa0b-7dbb-489c-a698-38018574fed8 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:35.258198 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b8faaa0b-7dbb-489c-a698-38018574fed8 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:35.259281 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b8faaa0b-7dbb-489c-a698-38018574fed8 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:35.260050 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b8faaa0b-7dbb-489c-a698-38018574fed8 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:35.260480 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b8faaa0b-7dbb-489c-a698-38018574fed8 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:35.334593 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b8faaa0b-7dbb-489c-a698-38018574fed8 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:35.342681 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b8faaa0b-7dbb-489c-a698-38018574fed8 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1511 microversion: 2.1 time: 0.096967 Jul 20 15:44:35.346396 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 564/1125] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:35 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1511 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:35.515035 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-5e9f60fd-2a1f-4512-aa6e-11b55acae0e4 req-01b1b04b-7b7a-49b5-8a48-4171c303b507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dd5710a-4106-4dcd-8ec4-083d49813b41", "name": "network-vif-deleted", "tag": "9062b142-2a3f-4a67-a60e-b3ba58fb3834"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:44:35.523713 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-5e9f60fd-2a1f-4512-aa6e-11b55acae0e4 req-01b1b04b-7b7a-49b5-8a48-4171c303b507 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:35.526764 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-5e9f60fd-2a1f-4512-aa6e-11b55acae0e4 req-01b1b04b-7b7a-49b5-8a48-4171c303b507 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:35.541480 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-5e9f60fd-2a1f-4512-aa6e-11b55acae0e4 req-01b1b04b-7b7a-49b5-8a48-4171c303b507 service nova] Creating event network-vif-deleted:9062b142-2a3f-4a67-a60e-b3ba58fb3834 for instance 8dd5710a-4106-4dcd-8ec4-083d49813b41 on hv-cinder-81914 Jul 20 15:44:35.558598 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-5e9f60fd-2a1f-4512-aa6e-11b55acae0e4 req-01b1b04b-7b7a-49b5-8a48-4171c303b507 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047016 Jul 20 15:44:35.559561 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 562/1126] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:44:36.361307 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-9ad3bb2d-7bd8-449d-85ce-d9316a067835 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:36.361929 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-9ad3bb2d-7bd8-449d-85ce-d9316a067835 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:36.369264 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9ad3bb2d-7bd8-449d-85ce-d9316a067835 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:36.369715 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9ad3bb2d-7bd8-449d-85ce-d9316a067835 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:36.370507 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9ad3bb2d-7bd8-449d-85ce-d9316a067835 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:36.370945 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9ad3bb2d-7bd8-449d-85ce-d9316a067835 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:36.403934 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9ad3bb2d-7bd8-449d-85ce-d9316a067835 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:36.404379 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9ad3bb2d-7bd8-449d-85ce-d9316a067835 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:36.405025 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.objects.instance [None req-9ad3bb2d-7bd8-449d-85ce-d9316a067835 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lazy-loading 'fault' on Instance uuid 8dd5710a-4106-4dcd-8ec4-083d49813b41 {{(pid=124712) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:44:36.449990 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-9ad3bb2d-7bd8-449d-85ce-d9316a067835 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:36.459660 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-9ad3bb2d-7bd8-449d-85ce-d9316a067835 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 200 len: 1231 microversion: 2.1 time: 0.102684 Jul 20 15:44:36.460251 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 565/1127] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:36 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:37.478664 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-9ec57afd-ac16-4e33-90a8-7865532af5ff tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:37.479398 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-9ec57afd-ac16-4e33-90a8-7865532af5ff tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:37.485600 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9ec57afd-ac16-4e33-90a8-7865532af5ff tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:37.486042 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9ec57afd-ac16-4e33-90a8-7865532af5ff tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:37.486841 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9ec57afd-ac16-4e33-90a8-7865532af5ff tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:37.487273 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-9ec57afd-ac16-4e33-90a8-7865532af5ff tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:37.500941 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-9ec57afd-ac16-4e33-90a8-7865532af5ff tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] HTTP exception thrown: Instance 8dd5710a-4106-4dcd-8ec4-083d49813b41 could not be found. Jul 20 15:44:37.502613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-9ec57afd-ac16-4e33-90a8-7865532af5ff tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Request method failure captured: Jul 20 15:44:37.502613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 HTTP/1.1 Jul 20 15:44:37.502613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:44:37.502613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:44:37.502613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:44:37.502613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:44:37.502613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:44:37.502613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:44:37.502613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:44:37.502613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:44:37.502613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2CIqB4z9r5hIY3uyG1t3ZhjRQftGwjcoDL2F9ce-WcSFLq28VkW2hwb8TfRxyqsmke9qALowC5OnsmA-BBjM6-QS9JAPLWdSOTh2zmP3315w7k7fV6aqLiEvqIfKNj-MO81pjG5BUtYSTP7ys-ugLW57tgf4K5S8HluxOkrwKAU6A4M Jul 20 15:44:37.502613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:44:37.502613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:44:37.502613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:44:37.502613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:44:37.502613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:44:37.502613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:44:37.502613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: 68372ee91fb843108d3b0cb1c99cd186 Jul 20 15:44:37.502613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-TestVolumeBootPattern-884236090 Jul 20 15:44:37.502613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:44:37.502613 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:44:37.504357 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/68372ee91fb843108d3b0cb1c99cd186"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/68372ee91fb843108d3b0cb1c99cd186"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_68372ee91fb843108d3b0cb1c99cd186", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/68372ee91fb843108d3b0cb1c99cd186"}]}] Jul 20 15:44:37.504357 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-TestVolumeBootPattern-884236090 Jul 20 15:44:37.504357 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: 68372ee91fb843108d3b0cb1c99cd186 Jul 20 15:44:37.504357 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-TestVolumeBootPattern-884236090 Jul 20 15:44:37.504357 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-TestVolumeBootPattern-884236090-project Jul 20 15:44:37.504357 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:44:37.504357 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:44:37.504357 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: cb4dc884b7eb4aa8a0adcdb46c5f9586 Jul 20 15:44:37.504357 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-TestVolumeBootPattern-884236090-project Jul 20 15:44:37.504357 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: > Jul 20 15:44:37.504357 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Instance 8dd5710a-4106-4dcd-8ec4-083d49813b41 could not be found. Jul 20 15:44:37.504357 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': '8dd5710a-4106-4dcd-8ec4-083d49813b41'} Jul 20 15:44:37.505468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:44:37.505468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:44:37.505468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:44:37.505468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:44:37.505468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:44:37.505468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:44:37.505468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:44:37.505468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:44:37.505468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:44:37.505468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:44:37.505468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dd5710a-4106-4dcd-8ec4-083d49813b41 could not be found. Jul 20 15:44:37.505468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:44:37.505468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:44:37.505468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:44:37.505468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:44:37.505468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:44:37.505468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:44:37.505468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:44:37.505468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:44:37.505468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:44:37.507963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:44:37.507963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:44:37.507963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:44:37.507963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:44:37.507963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:44:37.507963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:44:37.507963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:44:37.507963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dd5710a-4106-4dcd-8ec4-083d49813b41 could not be found. Jul 20 15:44:37.507963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:44:37.507963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:44:37.507963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:44:37.507963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:44:37.507963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:44:37.507963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:44:37.507963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:44:37.507963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:44:37.507963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dd5710a-4106-4dcd-8ec4-083d49813b41 could not be found. Jul 20 15:44:37.507963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:44:37.509316 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-9ec57afd-ac16-4e33-90a8-7865532af5ff tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Returning 404 to user: Instance 8dd5710a-4106-4dcd-8ec4-083d49813b41 could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:44:37.509316 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-9ec57afd-ac16-4e33-90a8-7865532af5ff tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 404 len: 111 microversion: 2.1 time: 0.030683 Jul 20 15:44:37.509316 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 563/1128] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:37 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:44:37.597863 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-705a9130-8cdd-4cc8-95d0-ca269de5dad1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-876892323", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1520672230", "security_groups": [{"name": "tempest-secgroup-smoke-463581945"}], "block_device_mapping_v2": [{"uuid": "8627cabd-35d9-449e-afd8-f64dfa6d160c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8628016f-4714-4c11-b108-0d43d71372c8"}]}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:44:37.708587 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.network.neutron [None req-705a9130-8cdd-4cc8-95d0-ca269de5dad1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] validate_networks() for [('8628016f-4714-4c11-b108-0d43d71372c8', None, None, None, None, None)] {{(pid=124712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 15:44:38.102956 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-705a9130-8cdd-4cc8-95d0-ca269de5dad1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Flavor limits 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 15:44:38.103375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-705a9130-8cdd-4cc8-95d0-ca269de5dad1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Image limits 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 15:44:38.103841 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-705a9130-8cdd-4cc8-95d0-ca269de5dad1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Flavor pref 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 15:44:38.104245 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-705a9130-8cdd-4cc8-95d0-ca269de5dad1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Image pref 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 15:44:38.104651 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-705a9130-8cdd-4cc8-95d0-ca269de5dad1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 15:44:38.113800 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-705a9130-8cdd-4cc8-95d0-ca269de5dad1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:38.114239 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-705a9130-8cdd-4cc8-95d0-ca269de5dad1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:38.115050 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-705a9130-8cdd-4cc8-95d0-ca269de5dad1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:38.115479 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-705a9130-8cdd-4cc8-95d0-ca269de5dad1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:38.132596 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-705a9130-8cdd-4cc8-95d0-ca269de5dad1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Getting quotas for project 68372ee91fb843108d3b0cb1c99cd186. Resources: {'instances', 'ram', 'cores'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:44:38.137050 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-705a9130-8cdd-4cc8-95d0-ca269de5dad1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Getting quotas for user cb4dc884b7eb4aa8a0adcdb46c5f9586 and project 68372ee91fb843108d3b0cb1c99cd186. Resources: {'instances', 'ram', 'cores'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:44:38.194629 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-705a9130-8cdd-4cc8-95d0-ca269de5dad1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Going to run 1 instances... {{(pid=124712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 15:44:38.197582 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-705a9130-8cdd-4cc8-95d0-ca269de5dad1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: cd6f927d-f118-4346-b787-006374e56107] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8627cabd-35d9-449e-afd8-f64dfa6d160c',volume_size=None,volume_type=None)] {{(pid=124712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 15:44:38.808456 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-705a9130-8cdd-4cc8-95d0-ca269de5dad1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.214425 Jul 20 15:44:38.809524 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 566/1129] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Jul 20 15:44:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 1216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 15:44:38.819475 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d4b182b5-3a16-4e91-90a9-98f9b836a3cb tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:38.820817 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-d4b182b5-3a16-4e91-90a9-98f9b836a3cb tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: cd6f927d-f118-4346-b787-006374e56107] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:38.884259 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d4b182b5-3a16-4e91-90a9-98f9b836a3cb tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:38.891094 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d4b182b5-3a16-4e91-90a9-98f9b836a3cb tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107" status: 200 len: 1094 microversion: 2.1 time: 0.075534 Jul 20 15:44:38.891747 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 564/1130] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:38 2022] GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:39.909412 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-8a57fff8-d05a-4de3-aa10-20b597f32228 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:39.910289 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-8a57fff8-d05a-4de3-aa10-20b597f32228 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: cd6f927d-f118-4346-b787-006374e56107] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:39.917438 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8a57fff8-d05a-4de3-aa10-20b597f32228 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:39.919412 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8a57fff8-d05a-4de3-aa10-20b597f32228 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:39.919412 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8a57fff8-d05a-4de3-aa10-20b597f32228 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:39.919412 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8a57fff8-d05a-4de3-aa10-20b597f32228 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:39.981992 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-8a57fff8-d05a-4de3-aa10-20b597f32228 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:39.989485 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-8a57fff8-d05a-4de3-aa10-20b597f32228 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107" status: 200 len: 1144 microversion: 2.1 time: 0.084540 Jul 20 15:44:39.990061 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 567/1131] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:39 2022] GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:41.007737 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-e697989b-7449-47e8-a0f9-5cbac85df768 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:41.008926 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-e697989b-7449-47e8-a0f9-5cbac85df768 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: cd6f927d-f118-4346-b787-006374e56107] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:41.016332 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e697989b-7449-47e8-a0f9-5cbac85df768 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:41.016779 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e697989b-7449-47e8-a0f9-5cbac85df768 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:41.017548 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e697989b-7449-47e8-a0f9-5cbac85df768 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:41.017980 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-e697989b-7449-47e8-a0f9-5cbac85df768 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:41.080057 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-e697989b-7449-47e8-a0f9-5cbac85df768 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:41.088027 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-e697989b-7449-47e8-a0f9-5cbac85df768 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107" status: 200 len: 1192 microversion: 2.1 time: 0.084218 Jul 20 15:44:41.088590 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 565/1132] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:41 2022] GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107 => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:42.105802 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b173aa56-b092-4a41-8013-ef629c73af9b tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:42.106636 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b173aa56-b092-4a41-8013-ef629c73af9b tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: cd6f927d-f118-4346-b787-006374e56107] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:42.113309 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b173aa56-b092-4a41-8013-ef629c73af9b tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:42.113756 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b173aa56-b092-4a41-8013-ef629c73af9b tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:42.114806 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b173aa56-b092-4a41-8013-ef629c73af9b tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:42.115297 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-b173aa56-b092-4a41-8013-ef629c73af9b tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:42.182046 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b173aa56-b092-4a41-8013-ef629c73af9b tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:42.189578 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b173aa56-b092-4a41-8013-ef629c73af9b tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107" status: 200 len: 1210 microversion: 2.1 time: 0.088278 Jul 20 15:44:42.190140 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 568/1133] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:42 2022] GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107 => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:43.206010 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-887263d4-1fef-4695-9e59-ccaa42d8dbc9 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:43.206639 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-887263d4-1fef-4695-9e59-ccaa42d8dbc9 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: cd6f927d-f118-4346-b787-006374e56107] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:43.215407 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-887263d4-1fef-4695-9e59-ccaa42d8dbc9 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:43.215927 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-887263d4-1fef-4695-9e59-ccaa42d8dbc9 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:43.216972 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-887263d4-1fef-4695-9e59-ccaa42d8dbc9 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:43.218658 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-887263d4-1fef-4695-9e59-ccaa42d8dbc9 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:43.382618 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-887263d4-1fef-4695-9e59-ccaa42d8dbc9 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:43.391882 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-887263d4-1fef-4695-9e59-ccaa42d8dbc9 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107" status: 200 len: 1277 microversion: 2.1 time: 0.189775 Jul 20 15:44:43.392514 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 566/1134] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:43 2022] GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107 => generated 1277 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:43.558512 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-34befcac-b602-48c8-bcd8-e209fe771198 req-8f300239-8823-4dcb-9e01-50520a70b11b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd6f927d-f118-4346-b787-006374e56107", "tag": "79406cc4-e652-4f2a-9034-e4eee6709cd7"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:44:43.578378 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-34befcac-b602-48c8-bcd8-e209fe771198 req-8f300239-8823-4dcb-9e01-50520a70b11b service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:43.578877 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-34befcac-b602-48c8-bcd8-e209fe771198 req-8f300239-8823-4dcb-9e01-50520a70b11b service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:43.595630 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-34befcac-b602-48c8-bcd8-e209fe771198 req-8f300239-8823-4dcb-9e01-50520a70b11b service nova] Creating event network-changed:79406cc4-e652-4f2a-9034-e4eee6709cd7 for instance cd6f927d-f118-4346-b787-006374e56107 on hv-cinder-81914 Jul 20 15:44:43.608008 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-34befcac-b602-48c8-bcd8-e209fe771198 req-8f300239-8823-4dcb-9e01-50520a70b11b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062672 Jul 20 15:44:43.609006 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 569/1135] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:44:44.416178 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-515325e0-17d9-4289-95d3-c8e65577ae5c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:44.417846 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-515325e0-17d9-4289-95d3-c8e65577ae5c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: cd6f927d-f118-4346-b787-006374e56107] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:44.430059 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-515325e0-17d9-4289-95d3-c8e65577ae5c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:44.430860 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-515325e0-17d9-4289-95d3-c8e65577ae5c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:44.432122 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-515325e0-17d9-4289-95d3-c8e65577ae5c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:44.432705 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-515325e0-17d9-4289-95d3-c8e65577ae5c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:44.589599 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-515325e0-17d9-4289-95d3-c8e65577ae5c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:44.597863 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-515325e0-17d9-4289-95d3-c8e65577ae5c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107" status: 200 len: 1265 microversion: 2.1 time: 0.192443 Jul 20 15:44:44.598547 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 567/1136] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:44 2022] GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:45.620193 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-66e2ad1d-1600-4433-ad91-f8d70bd68d71 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:45.620891 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-66e2ad1d-1600-4433-ad91-f8d70bd68d71 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: cd6f927d-f118-4346-b787-006374e56107] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:45.627632 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-66e2ad1d-1600-4433-ad91-f8d70bd68d71 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:45.628084 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-66e2ad1d-1600-4433-ad91-f8d70bd68d71 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:45.628890 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-66e2ad1d-1600-4433-ad91-f8d70bd68d71 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:45.629347 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-66e2ad1d-1600-4433-ad91-f8d70bd68d71 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:45.771632 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-66e2ad1d-1600-4433-ad91-f8d70bd68d71 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:45.779603 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-66e2ad1d-1600-4433-ad91-f8d70bd68d71 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107" status: 200 len: 1265 microversion: 2.1 time: 0.164856 Jul 20 15:44:45.780202 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 570/1137] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:45 2022] GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:46.796420 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-98eeb26a-7b9b-4ff6-9e5f-d2e26d537480 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:46.797103 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-98eeb26a-7b9b-4ff6-9e5f-d2e26d537480 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: cd6f927d-f118-4346-b787-006374e56107] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:46.803446 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-98eeb26a-7b9b-4ff6-9e5f-d2e26d537480 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:46.803894 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-98eeb26a-7b9b-4ff6-9e5f-d2e26d537480 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:46.804648 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-98eeb26a-7b9b-4ff6-9e5f-d2e26d537480 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:46.805085 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-98eeb26a-7b9b-4ff6-9e5f-d2e26d537480 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:46.939805 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-98eeb26a-7b9b-4ff6-9e5f-d2e26d537480 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:46.948432 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-98eeb26a-7b9b-4ff6-9e5f-d2e26d537480 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107" status: 200 len: 1265 microversion: 2.1 time: 0.155902 Jul 20 15:44:46.949008 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 568/1138] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:46 2022] GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:47.964570 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-362b6854-0e5c-42ee-8e1c-ac55862c57db tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:47.965110 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-362b6854-0e5c-42ee-8e1c-ac55862c57db tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: cd6f927d-f118-4346-b787-006374e56107] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:47.971704 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-362b6854-0e5c-42ee-8e1c-ac55862c57db tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:47.972159 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-362b6854-0e5c-42ee-8e1c-ac55862c57db tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:47.972925 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-362b6854-0e5c-42ee-8e1c-ac55862c57db tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:47.973363 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-362b6854-0e5c-42ee-8e1c-ac55862c57db tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:48.112084 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-362b6854-0e5c-42ee-8e1c-ac55862c57db tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:48.120105 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-362b6854-0e5c-42ee-8e1c-ac55862c57db tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107" status: 200 len: 1265 microversion: 2.1 time: 0.159426 Jul 20 15:44:48.120689 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 571/1139] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:47 2022] GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:49.140182 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-fd462dcc-1e7c-4a67-921d-241923d6c45a tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:49.140788 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-fd462dcc-1e7c-4a67-921d-241923d6c45a tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: cd6f927d-f118-4346-b787-006374e56107] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:49.142809 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=2 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:44:49.147758 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fd462dcc-1e7c-4a67-921d-241923d6c45a tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:49.150497 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fd462dcc-1e7c-4a67-921d-241923d6c45a tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:49.150497 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fd462dcc-1e7c-4a67-921d-241923d6c45a tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:49.150497 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fd462dcc-1e7c-4a67-921d-241923d6c45a tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:49.286942 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-fd462dcc-1e7c-4a67-921d-241923d6c45a tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:49.294747 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-fd462dcc-1e7c-4a67-921d-241923d6c45a tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107" status: 200 len: 1265 microversion: 2.1 time: 0.158551 Jul 20 15:44:49.295330 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 569/1140] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:49 2022] GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:50.312230 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-bffc8d31-3da6-42a5-b84e-9c6ef3e53094 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:50.312872 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-bffc8d31-3da6-42a5-b84e-9c6ef3e53094 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: cd6f927d-f118-4346-b787-006374e56107] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:50.314933 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=2 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:44:50.315604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=6 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:44:50.321028 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bffc8d31-3da6-42a5-b84e-9c6ef3e53094 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:50.321737 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bffc8d31-3da6-42a5-b84e-9c6ef3e53094 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:50.322587 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bffc8d31-3da6-42a5-b84e-9c6ef3e53094 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:50.323027 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-bffc8d31-3da6-42a5-b84e-9c6ef3e53094 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:50.462015 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-bffc8d31-3da6-42a5-b84e-9c6ef3e53094 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:50.469512 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-bffc8d31-3da6-42a5-b84e-9c6ef3e53094 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107" status: 200 len: 1265 microversion: 2.1 time: 0.161253 Jul 20 15:44:50.470076 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 572/1141] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:50 2022] GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:51.486302 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-3dbef578-cf8c-4d05-9a70-bd3e15923a10 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:51.486850 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-3dbef578-cf8c-4d05-9a70-bd3e15923a10 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: cd6f927d-f118-4346-b787-006374e56107] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:51.493420 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3dbef578-cf8c-4d05-9a70-bd3e15923a10 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:51.493862 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3dbef578-cf8c-4d05-9a70-bd3e15923a10 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:51.494652 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3dbef578-cf8c-4d05-9a70-bd3e15923a10 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:51.495084 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3dbef578-cf8c-4d05-9a70-bd3e15923a10 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:51.644603 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-3dbef578-cf8c-4d05-9a70-bd3e15923a10 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:51.653093 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-3dbef578-cf8c-4d05-9a70-bd3e15923a10 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107" status: 200 len: 1265 microversion: 2.1 time: 0.170775 Jul 20 15:44:51.653690 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 570/1142] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:51 2022] GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:52.671034 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-654002a1-4f29-45ba-90da-4bd2b9579746 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:52.671644 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-654002a1-4f29-45ba-90da-4bd2b9579746 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: cd6f927d-f118-4346-b787-006374e56107] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:52.679133 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-654002a1-4f29-45ba-90da-4bd2b9579746 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:52.679568 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-654002a1-4f29-45ba-90da-4bd2b9579746 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:52.680476 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-654002a1-4f29-45ba-90da-4bd2b9579746 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:52.681005 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-654002a1-4f29-45ba-90da-4bd2b9579746 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:52.814313 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-654002a1-4f29-45ba-90da-4bd2b9579746 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:52.822049 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-654002a1-4f29-45ba-90da-4bd2b9579746 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107" status: 200 len: 1265 microversion: 2.1 time: 0.155559 Jul 20 15:44:52.823160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 573/1143] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:52 2022] GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:53.155126 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-2739ce27-6b44-42fa-a4de-7d7bd53bffe9 req-1ee738bd-a1bf-4698-987f-f35c8487ef53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd6f927d-f118-4346-b787-006374e56107", "name": "network-vif-plugged", "status": "completed", "tag": "79406cc4-e652-4f2a-9034-e4eee6709cd7"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:44:53.163853 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-2739ce27-6b44-42fa-a4de-7d7bd53bffe9 req-1ee738bd-a1bf-4698-987f-f35c8487ef53 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:53.164374 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-2739ce27-6b44-42fa-a4de-7d7bd53bffe9 req-1ee738bd-a1bf-4698-987f-f35c8487ef53 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:53.185339 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-2739ce27-6b44-42fa-a4de-7d7bd53bffe9 req-1ee738bd-a1bf-4698-987f-f35c8487ef53 service nova] Creating event network-vif-plugged:79406cc4-e652-4f2a-9034-e4eee6709cd7 for instance cd6f927d-f118-4346-b787-006374e56107 on hv-cinder-81914 Jul 20 15:44:53.190854 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-2739ce27-6b44-42fa-a4de-7d7bd53bffe9 req-1ee738bd-a1bf-4698-987f-f35c8487ef53 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039474 Jul 20 15:44:53.191468 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 571/1144] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:44:53.840130 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-82befda8-dc31-4ae8-bef5-4cf8eaf817f9 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:53.840770 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-82befda8-dc31-4ae8-bef5-4cf8eaf817f9 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: cd6f927d-f118-4346-b787-006374e56107] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:53.847526 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-82befda8-dc31-4ae8-bef5-4cf8eaf817f9 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:53.848002 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-82befda8-dc31-4ae8-bef5-4cf8eaf817f9 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:53.848764 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-82befda8-dc31-4ae8-bef5-4cf8eaf817f9 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:53.849197 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-82befda8-dc31-4ae8-bef5-4cf8eaf817f9 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:54.231126 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-82befda8-dc31-4ae8-bef5-4cf8eaf817f9 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:54.239370 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-82befda8-dc31-4ae8-bef5-4cf8eaf817f9 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107" status: 200 len: 1265 microversion: 2.1 time: 0.403821 Jul 20 15:44:54.250358 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 574/1145] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:53 2022] GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107 => generated 1265 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:55.257580 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-51d98601-5bda-4651-a5d4-f108472308cd tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:55.258292 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-51d98601-5bda-4651-a5d4-f108472308cd tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: cd6f927d-f118-4346-b787-006374e56107] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:55.264657 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-51d98601-5bda-4651-a5d4-f108472308cd tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:55.265101 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-51d98601-5bda-4651-a5d4-f108472308cd tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:55.265856 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-51d98601-5bda-4651-a5d4-f108472308cd tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:55.266308 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-51d98601-5bda-4651-a5d4-f108472308cd tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:55.413033 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-51d98601-5bda-4651-a5d4-f108472308cd tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:55.421348 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-51d98601-5bda-4651-a5d4-f108472308cd tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107" status: 200 len: 1453 microversion: 2.1 time: 0.168526 Jul 20 15:44:55.421927 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 572/1146] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:55 2022] GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107 => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:55.437870 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-75190961-4b75-476a-a735-056a7f0545c3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:44:55.438515 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-75190961-4b75-476a-a735-056a7f0545c3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: cd6f927d-f118-4346-b787-006374e56107] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:44:55.445025 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-75190961-4b75-476a-a735-056a7f0545c3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:55.445469 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-75190961-4b75-476a-a735-056a7f0545c3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:55.446503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-75190961-4b75-476a-a735-056a7f0545c3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:55.446933 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-75190961-4b75-476a-a735-056a7f0545c3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:55.581695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-75190961-4b75-476a-a735-056a7f0545c3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:44:55.589675 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-75190961-4b75-476a-a735-056a7f0545c3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107" status: 200 len: 1453 microversion: 2.1 time: 0.155606 Jul 20 15:44:55.590238 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 575/1147] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:44:55 2022] GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:44:57.881663 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-bca0370c-5a52-452d-adf6-4ad7291ad98e req-3d834862-44af-4a76-9ae7-0cb81caf11cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd6f927d-f118-4346-b787-006374e56107", "tag": "79406cc4-e652-4f2a-9034-e4eee6709cd7"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:44:57.890756 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-bca0370c-5a52-452d-adf6-4ad7291ad98e req-3d834862-44af-4a76-9ae7-0cb81caf11cf service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:44:57.891197 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-bca0370c-5a52-452d-adf6-4ad7291ad98e req-3d834862-44af-4a76-9ae7-0cb81caf11cf service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:44:57.902465 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-bca0370c-5a52-452d-adf6-4ad7291ad98e req-3d834862-44af-4a76-9ae7-0cb81caf11cf service nova] Creating event network-changed:79406cc4-e652-4f2a-9034-e4eee6709cd7 for instance cd6f927d-f118-4346-b787-006374e56107 on hv-cinder-81914 Jul 20 15:44:57.907734 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-bca0370c-5a52-452d-adf6-4ad7291ad98e req-3d834862-44af-4a76-9ae7-0cb81caf11cf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029820 Jul 20 15:44:57.908365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 573/1148] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:46:35.197573 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:46:35.198503 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=72 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:46:35.202667 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-21a9eee1-2e25-4f5a-8b63-0633b0c81291 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1405193440", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1520672230", "security_groups": [{"name": "tempest-secgroup-smoke-463581945"}], "block_device_mapping_v2": [{"uuid": "b5b45d6e-65ac-44e0-9a82-2cea6f599266", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8628016f-4714-4c11-b108-0d43d71372c8"}]}} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:46:35.334883 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.network.neutron [None req-21a9eee1-2e25-4f5a-8b63-0633b0c81291 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] validate_networks() for [('8628016f-4714-4c11-b108-0d43d71372c8', None, None, None, None, None)] {{(pid=124712) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 15:46:35.897742 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-21a9eee1-2e25-4f5a-8b63-0633b0c81291 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Flavor limits 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 15:46:35.898165 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-21a9eee1-2e25-4f5a-8b63-0633b0c81291 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Image limits 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 15:46:35.898675 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-21a9eee1-2e25-4f5a-8b63-0633b0c81291 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Flavor pref 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 15:46:35.899081 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-21a9eee1-2e25-4f5a-8b63-0633b0c81291 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Image pref 0:0:0 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 15:46:35.899489 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.virt.hardware [None req-21a9eee1-2e25-4f5a-8b63-0633b0c81291 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124712) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 15:46:35.908896 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-21a9eee1-2e25-4f5a-8b63-0633b0c81291 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:35.909337 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-21a9eee1-2e25-4f5a-8b63-0633b0c81291 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:35.910144 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-21a9eee1-2e25-4f5a-8b63-0633b0c81291 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:35.910604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-21a9eee1-2e25-4f5a-8b63-0633b0c81291 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:35.929866 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-21a9eee1-2e25-4f5a-8b63-0633b0c81291 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Getting quotas for project 68372ee91fb843108d3b0cb1c99cd186. Resources: {'instances', 'ram', 'cores'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 15:46:35.934115 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.quota [None req-21a9eee1-2e25-4f5a-8b63-0633b0c81291 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Getting quotas for user cb4dc884b7eb4aa8a0adcdb46c5f9586 and project 68372ee91fb843108d3b0cb1c99cd186. Resources: {'instances', 'ram', 'cores'} {{(pid=124712) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 15:46:36.004035 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-21a9eee1-2e25-4f5a-8b63-0633b0c81291 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Going to run 1 instances... {{(pid=124712) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 15:46:36.006154 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-21a9eee1-2e25-4f5a-8b63-0633b0c81291 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b5b45d6e-65ac-44e0-9a82-2cea6f599266',volume_size=None,volume_type=None)] {{(pid=124712) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 15:46:36.497612 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-21a9eee1-2e25-4f5a-8b63-0633b0c81291 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.301440 Jul 20 15:46:36.498823 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 576/1149] 10.222.0.78 () {60 vars in 1146 bytes} [Wed Jul 20 15:46:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 15:46:36.512731 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:46:36.514238 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:46:36.522582 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-3049e6d2-0a2d-4a12-ba13-b3e25294b2e0 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:46:36.523833 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-3049e6d2-0a2d-4a12-ba13-b3e25294b2e0 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:46:36.587549 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-3049e6d2-0a2d-4a12-ba13-b3e25294b2e0 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:46:36.595190 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-3049e6d2-0a2d-4a12-ba13-b3e25294b2e0 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1095 microversion: 2.1 time: 0.086492 Jul 20 15:46:36.595762 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 574/1150] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:46:36 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1095 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:46:37.613754 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-b9b93484-fd89-4007-9a6f-c9af2239f36e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:46:37.614588 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-b9b93484-fd89-4007-9a6f-c9af2239f36e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:46:37.670671 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-b9b93484-fd89-4007-9a6f-c9af2239f36e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:46:37.678282 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-b9b93484-fd89-4007-9a6f-c9af2239f36e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1095 microversion: 2.1 time: 0.069824 Jul 20 15:46:37.678849 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 577/1151] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:46:37 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:46:38.843785 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-bbe8175e-767a-439d-9476-fa4a8c9b0424 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:46:38.844404 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-bbe8175e-767a-439d-9476-fa4a8c9b0424 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:46:38.901434 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-bbe8175e-767a-439d-9476-fa4a8c9b0424 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:46:38.910372 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-bbe8175e-767a-439d-9476-fa4a8c9b0424 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1095 microversion: 2.1 time: 0.215467 Jul 20 15:46:38.910372 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 575/1152] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:46:38 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1095 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:46:39.924976 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-ff928788-89b3-417a-b8bd-f641c46e4346 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:46:39.925600 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-ff928788-89b3-417a-b8bd-f641c46e4346 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:46:39.991565 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-ff928788-89b3-417a-b8bd-f641c46e4346 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:46:39.998779 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-ff928788-89b3-417a-b8bd-f641c46e4346 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1095 microversion: 2.1 time: 0.077614 Jul 20 15:46:39.999358 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 578/1153] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:46:39 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:46:41.023595 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-312b3238-5cf5-47f3-8118-435b4d763485 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:46:41.024415 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-312b3238-5cf5-47f3-8118-435b4d763485 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:46:41.031863 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-312b3238-5cf5-47f3-8118-435b4d763485 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:41.032319 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-312b3238-5cf5-47f3-8118-435b4d763485 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:41.033128 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-312b3238-5cf5-47f3-8118-435b4d763485 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:41.033560 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-312b3238-5cf5-47f3-8118-435b4d763485 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:41.100671 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-312b3238-5cf5-47f3-8118-435b4d763485 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:46:41.113932 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-312b3238-5cf5-47f3-8118-435b4d763485 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1145 microversion: 2.1 time: 0.096642 Jul 20 15:46:41.114985 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 576/1154] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:46:41 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1145 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:46:42.133899 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-7fc3d54c-aff3-4bf0-9ee6-b0ffb0aad8f7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:46:42.137277 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-7fc3d54c-aff3-4bf0-9ee6-b0ffb0aad8f7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:46:42.142468 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7fc3d54c-aff3-4bf0-9ee6-b0ffb0aad8f7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:42.143028 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7fc3d54c-aff3-4bf0-9ee6-b0ffb0aad8f7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:42.143785 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7fc3d54c-aff3-4bf0-9ee6-b0ffb0aad8f7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:42.144229 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7fc3d54c-aff3-4bf0-9ee6-b0ffb0aad8f7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:42.218389 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-7fc3d54c-aff3-4bf0-9ee6-b0ffb0aad8f7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:46:42.231680 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-7fc3d54c-aff3-4bf0-9ee6-b0ffb0aad8f7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1137 microversion: 2.1 time: 0.102306 Jul 20 15:46:42.232617 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 579/1155] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:46:42 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1137 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:46:43.253889 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c943d6f5-61f5-450e-bb4a-62c1613386ed tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:46:43.254661 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c943d6f5-61f5-450e-bb4a-62c1613386ed tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:46:43.261812 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c943d6f5-61f5-450e-bb4a-62c1613386ed tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:43.263310 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c943d6f5-61f5-450e-bb4a-62c1613386ed tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:43.264202 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c943d6f5-61f5-450e-bb4a-62c1613386ed tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:43.265597 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c943d6f5-61f5-450e-bb4a-62c1613386ed tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:43.339311 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c943d6f5-61f5-450e-bb4a-62c1613386ed tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:46:43.350417 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c943d6f5-61f5-450e-bb4a-62c1613386ed tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1211 microversion: 2.1 time: 0.100291 Jul 20 15:46:43.351104 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 577/1156] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:46:43 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:46:44.370853 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-30445acf-691c-4029-ab3a-ffe5344f85f4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:46:44.371978 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-30445acf-691c-4029-ab3a-ffe5344f85f4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:46:44.384290 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-30445acf-691c-4029-ab3a-ffe5344f85f4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:44.396457 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-30445acf-691c-4029-ab3a-ffe5344f85f4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:44.397385 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-30445acf-691c-4029-ab3a-ffe5344f85f4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:44.397903 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-30445acf-691c-4029-ab3a-ffe5344f85f4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:44.593399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-30445acf-691c-4029-ab3a-ffe5344f85f4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:46:44.601830 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-30445acf-691c-4029-ab3a-ffe5344f85f4 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1278 microversion: 2.1 time: 0.235927 Jul 20 15:46:44.602417 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 580/1157] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:46:44 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1278 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:46:45.391148 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-cf07c414-cf15-4770-802b-961e0d8a7fe8 req-9fe3c4b7-51b9-47f9-8685-77182a9d26da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c75339-7bf0-44d2-bfd6-9423a5bee629", "tag": "694cd4a5-edf0-4c30-8149-2d9993368cc5"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:46:45.403706 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-cf07c414-cf15-4770-802b-961e0d8a7fe8 req-9fe3c4b7-51b9-47f9-8685-77182a9d26da service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:45.404292 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-cf07c414-cf15-4770-802b-961e0d8a7fe8 req-9fe3c4b7-51b9-47f9-8685-77182a9d26da service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:45.422671 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-cf07c414-cf15-4770-802b-961e0d8a7fe8 req-9fe3c4b7-51b9-47f9-8685-77182a9d26da service nova] Creating event network-changed:694cd4a5-edf0-4c30-8149-2d9993368cc5 for instance 66c75339-7bf0-44d2-bfd6-9423a5bee629 on hv-cinder-81914 Jul 20 15:46:45.428263 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-cf07c414-cf15-4770-802b-961e0d8a7fe8 req-9fe3c4b7-51b9-47f9-8685-77182a9d26da service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052264 Jul 20 15:46:45.428987 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 578/1158] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:46:45.618912 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-80ff5de9-f985-4a07-b712-55af03e9a7e3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:46:45.620156 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-80ff5de9-f985-4a07-b712-55af03e9a7e3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:46:45.632139 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-80ff5de9-f985-4a07-b712-55af03e9a7e3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:45.632879 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-80ff5de9-f985-4a07-b712-55af03e9a7e3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:45.634545 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-80ff5de9-f985-4a07-b712-55af03e9a7e3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:45.635554 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-80ff5de9-f985-4a07-b712-55af03e9a7e3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:45.840488 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-80ff5de9-f985-4a07-b712-55af03e9a7e3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:46:45.848359 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-80ff5de9-f985-4a07-b712-55af03e9a7e3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1266 microversion: 2.1 time: 0.233270 Jul 20 15:46:45.848862 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 581/1159] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:46:45 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:46:46.868377 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-d7eee485-0e11-45de-bad0-c240b7fde074 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:46:46.869084 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-d7eee485-0e11-45de-bad0-c240b7fde074 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:46:46.875699 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d7eee485-0e11-45de-bad0-c240b7fde074 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:46.876166 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d7eee485-0e11-45de-bad0-c240b7fde074 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:46.876940 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d7eee485-0e11-45de-bad0-c240b7fde074 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:46.877374 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-d7eee485-0e11-45de-bad0-c240b7fde074 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:47.034852 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-d7eee485-0e11-45de-bad0-c240b7fde074 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:46:47.048046 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-d7eee485-0e11-45de-bad0-c240b7fde074 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1266 microversion: 2.1 time: 0.185784 Jul 20 15:46:47.048636 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 579/1160] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:46:46 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:46:48.066211 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-8a9cb0c1-1f23-4c43-99f8-cd23c2f1302e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:46:48.066856 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-8a9cb0c1-1f23-4c43-99f8-cd23c2f1302e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:46:48.068980 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=2 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:46:48.075624 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8a9cb0c1-1f23-4c43-99f8-cd23c2f1302e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:48.076131 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8a9cb0c1-1f23-4c43-99f8-cd23c2f1302e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:48.077523 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8a9cb0c1-1f23-4c43-99f8-cd23c2f1302e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:48.078144 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8a9cb0c1-1f23-4c43-99f8-cd23c2f1302e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:48.222814 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-8a9cb0c1-1f23-4c43-99f8-cd23c2f1302e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:46:48.230160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-8a9cb0c1-1f23-4c43-99f8-cd23c2f1302e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1266 microversion: 2.1 time: 0.168906 Jul 20 15:46:48.230747 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 582/1161] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:46:48 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:46:49.249510 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-4d68d1d2-ec6b-495f-84d7-8059c41b8fa6 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:46:49.250382 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-4d68d1d2-ec6b-495f-84d7-8059c41b8fa6 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:46:49.253889 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell0:SELECT=4 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:46:49.261178 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4d68d1d2-ec6b-495f-84d7-8059c41b8fa6 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:49.261963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4d68d1d2-ec6b-495f-84d7-8059c41b8fa6 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:49.263368 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4d68d1d2-ec6b-495f-84d7-8059c41b8fa6 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:49.264630 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-4d68d1d2-ec6b-495f-84d7-8059c41b8fa6 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:49.404814 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-4d68d1d2-ec6b-495f-84d7-8059c41b8fa6 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:46:49.412827 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-4d68d1d2-ec6b-495f-84d7-8059c41b8fa6 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1266 microversion: 2.1 time: 0.169184 Jul 20 15:46:49.413294 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 580/1162] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:46:49 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:46:50.430529 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-9335924a-ae6d-493c-a17a-24abfb2ac3db tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:46:50.431141 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-9335924a-ae6d-493c-a17a-24abfb2ac3db tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:46:50.433520 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell0:SELECT=10 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:46:50.439301 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9335924a-ae6d-493c-a17a-24abfb2ac3db tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:50.439750 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9335924a-ae6d-493c-a17a-24abfb2ac3db tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:50.446491 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9335924a-ae6d-493c-a17a-24abfb2ac3db tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:50.446491 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-9335924a-ae6d-493c-a17a-24abfb2ac3db tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:50.732565 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-9335924a-ae6d-493c-a17a-24abfb2ac3db tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:46:50.746504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-9335924a-ae6d-493c-a17a-24abfb2ac3db tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1266 microversion: 2.1 time: 0.319508 Jul 20 15:46:50.747347 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 583/1163] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:46:50 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1266 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:46:51.775380 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-bb475774-7e2b-4b01-a224-fe83d58ea638 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:46:51.776032 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-bb475774-7e2b-4b01-a224-fe83d58ea638 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:46:51.783401 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bb475774-7e2b-4b01-a224-fe83d58ea638 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:51.783852 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bb475774-7e2b-4b01-a224-fe83d58ea638 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:51.784627 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bb475774-7e2b-4b01-a224-fe83d58ea638 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:51.785062 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-bb475774-7e2b-4b01-a224-fe83d58ea638 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:51.988604 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-bb475774-7e2b-4b01-a224-fe83d58ea638 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:46:52.000878 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-bb475774-7e2b-4b01-a224-fe83d58ea638 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1266 microversion: 2.1 time: 0.229163 Jul 20 15:46:52.008130 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 581/1164] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:46:51 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:46:53.018385 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-76fac9a8-b944-4f3d-ab43-2d825e8c3629 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:46:53.019012 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-76fac9a8-b944-4f3d-ab43-2d825e8c3629 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:46:53.026031 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-76fac9a8-b944-4f3d-ab43-2d825e8c3629 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:53.026541 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-76fac9a8-b944-4f3d-ab43-2d825e8c3629 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:53.027352 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-76fac9a8-b944-4f3d-ab43-2d825e8c3629 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:53.027787 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-76fac9a8-b944-4f3d-ab43-2d825e8c3629 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:53.167468 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-76fac9a8-b944-4f3d-ab43-2d825e8c3629 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:46:53.175407 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-76fac9a8-b944-4f3d-ab43-2d825e8c3629 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1266 microversion: 2.1 time: 0.161716 Jul 20 15:46:53.175983 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 584/1165] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:46:53 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:46:54.193956 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-71b58aaa-f5be-4a0b-aaee-08160a061d88 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:46:54.194654 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-71b58aaa-f5be-4a0b-aaee-08160a061d88 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:46:54.201985 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-71b58aaa-f5be-4a0b-aaee-08160a061d88 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:54.202471 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-71b58aaa-f5be-4a0b-aaee-08160a061d88 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:54.203243 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-71b58aaa-f5be-4a0b-aaee-08160a061d88 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:54.203675 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-71b58aaa-f5be-4a0b-aaee-08160a061d88 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:54.339694 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-71b58aaa-f5be-4a0b-aaee-08160a061d88 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:46:54.347521 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-71b58aaa-f5be-4a0b-aaee-08160a061d88 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1266 microversion: 2.1 time: 0.158351 Jul 20 15:46:54.348028 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 582/1166] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:46:54 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:46:55.365210 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-a27283cc-7dcf-4f1f-8f2c-9358688784d1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:46:55.365844 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-a27283cc-7dcf-4f1f-8f2c-9358688784d1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:46:55.376089 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a27283cc-7dcf-4f1f-8f2c-9358688784d1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:55.377056 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a27283cc-7dcf-4f1f-8f2c-9358688784d1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:55.377652 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a27283cc-7dcf-4f1f-8f2c-9358688784d1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:55.378024 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-a27283cc-7dcf-4f1f-8f2c-9358688784d1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:55.537800 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-a27283cc-7dcf-4f1f-8f2c-9358688784d1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:46:55.546389 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-a27283cc-7dcf-4f1f-8f2c-9358688784d1 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1266 microversion: 2.1 time: 0.185670 Jul 20 15:46:55.561941 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 585/1167] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:46:55 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:46:56.563558 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-01216340-f19b-4f8d-bb67-ae0af1f41db3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:46:56.564225 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-01216340-f19b-4f8d-bb67-ae0af1f41db3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:46:56.571024 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-01216340-f19b-4f8d-bb67-ae0af1f41db3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:56.571474 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-01216340-f19b-4f8d-bb67-ae0af1f41db3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:56.572244 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-01216340-f19b-4f8d-bb67-ae0af1f41db3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:56.572736 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-01216340-f19b-4f8d-bb67-ae0af1f41db3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:56.711290 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-01216340-f19b-4f8d-bb67-ae0af1f41db3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:46:56.719259 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-01216340-f19b-4f8d-bb67-ae0af1f41db3 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1266 microversion: 2.1 time: 0.160094 Jul 20 15:46:56.719833 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 583/1168] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:46:56 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:46:57.544504 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-b829833f-c805-4b2e-ac2b-b253c1881b46 req-cd8f9efe-54cf-4035-a6d8-76d24ac1eb7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c75339-7bf0-44d2-bfd6-9423a5bee629", "name": "network-vif-plugged", "status": "completed", "tag": "694cd4a5-edf0-4c30-8149-2d9993368cc5"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:46:57.553978 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-b829833f-c805-4b2e-ac2b-b253c1881b46 req-cd8f9efe-54cf-4035-a6d8-76d24ac1eb7e service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:57.554625 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-b829833f-c805-4b2e-ac2b-b253c1881b46 req-cd8f9efe-54cf-4035-a6d8-76d24ac1eb7e service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:57.567048 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-b829833f-c805-4b2e-ac2b-b253c1881b46 req-cd8f9efe-54cf-4035-a6d8-76d24ac1eb7e service nova] Creating event network-vif-plugged:694cd4a5-edf0-4c30-8149-2d9993368cc5 for instance 66c75339-7bf0-44d2-bfd6-9423a5bee629 on hv-cinder-81914 Jul 20 15:46:57.572592 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-b829833f-c805-4b2e-ac2b-b253c1881b46 req-cd8f9efe-54cf-4035-a6d8-76d24ac1eb7e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032123 Jul 20 15:46:57.573196 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 586/1169] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:46:57.737210 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-fd879f4c-2d8b-4f14-8b69-20e862f12c20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:46:57.738511 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-fd879f4c-2d8b-4f14-8b69-20e862f12c20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:46:57.745290 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fd879f4c-2d8b-4f14-8b69-20e862f12c20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:57.752016 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fd879f4c-2d8b-4f14-8b69-20e862f12c20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:57.752016 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fd879f4c-2d8b-4f14-8b69-20e862f12c20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:57.752016 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-fd879f4c-2d8b-4f14-8b69-20e862f12c20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:57.902519 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-fd879f4c-2d8b-4f14-8b69-20e862f12c20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:46:57.909243 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-fd879f4c-2d8b-4f14-8b69-20e862f12c20 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1266 microversion: 2.1 time: 0.176530 Jul 20 15:46:57.909936 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 584/1170] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:46:57 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 15:46:58.927829 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-22c550e1-d14b-49c2-9354-3c3f3c55e3c7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:46:58.928511 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-22c550e1-d14b-49c2-9354-3c3f3c55e3c7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:46:58.934842 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-22c550e1-d14b-49c2-9354-3c3f3c55e3c7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:58.935240 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-22c550e1-d14b-49c2-9354-3c3f3c55e3c7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:58.936057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-22c550e1-d14b-49c2-9354-3c3f3c55e3c7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:46:58.936654 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-22c550e1-d14b-49c2-9354-3c3f3c55e3c7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:46:59.088865 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-22c550e1-d14b-49c2-9354-3c3f3c55e3c7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:46:59.097591 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-22c550e1-d14b-49c2-9354-3c3f3c55e3c7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1266 microversion: 2.1 time: 0.174696 Jul 20 15:46:59.098421 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 587/1171] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:46:58 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:47:00.114625 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-7125fef2-ffd0-42b7-894b-03b91a0b56bb tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:47:00.115232 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-7125fef2-ffd0-42b7-894b-03b91a0b56bb tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:47:00.121920 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7125fef2-ffd0-42b7-894b-03b91a0b56bb tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:47:00.122396 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7125fef2-ffd0-42b7-894b-03b91a0b56bb tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:47:00.123151 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7125fef2-ffd0-42b7-894b-03b91a0b56bb tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:47:00.123580 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7125fef2-ffd0-42b7-894b-03b91a0b56bb tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:47:00.255134 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-7125fef2-ffd0-42b7-894b-03b91a0b56bb tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:47:00.262688 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-7125fef2-ffd0-42b7-894b-03b91a0b56bb tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1454 microversion: 2.1 time: 0.151863 Jul 20 15:47:00.263277 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 585/1172] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:47:00 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:47:00.278815 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-244630c5-61ed-4442-b516-76a178510a59 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:47:00.279983 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-244630c5-61ed-4442-b516-76a178510a59 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:47:00.286582 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-244630c5-61ed-4442-b516-76a178510a59 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:47:00.287035 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-244630c5-61ed-4442-b516-76a178510a59 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:47:00.287798 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-244630c5-61ed-4442-b516-76a178510a59 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:47:00.288258 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-244630c5-61ed-4442-b516-76a178510a59 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:47:00.426594 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-244630c5-61ed-4442-b516-76a178510a59 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:47:00.434366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-244630c5-61ed-4442-b516-76a178510a59 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1454 microversion: 2.1 time: 0.159405 Jul 20 15:47:00.434949 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 588/1173] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:47:00 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1454 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:47:02.840550 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-8f09ef2a-53f1-405a-9c13-175f5344d836 req-a2f04e0a-f6f9-435c-9814-18a1e160c242 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c75339-7bf0-44d2-bfd6-9423a5bee629", "tag": "694cd4a5-edf0-4c30-8149-2d9993368cc5"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:47:02.849560 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-8f09ef2a-53f1-405a-9c13-175f5344d836 req-a2f04e0a-f6f9-435c-9814-18a1e160c242 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:47:02.850169 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-8f09ef2a-53f1-405a-9c13-175f5344d836 req-a2f04e0a-f6f9-435c-9814-18a1e160c242 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:47:02.864010 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-8f09ef2a-53f1-405a-9c13-175f5344d836 req-a2f04e0a-f6f9-435c-9814-18a1e160c242 service nova] Creating event network-changed:694cd4a5-edf0-4c30-8149-2d9993368cc5 for instance 66c75339-7bf0-44d2-bfd6-9423a5bee629 on hv-cinder-81914 Jul 20 15:47:02.869359 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-8f09ef2a-53f1-405a-9c13-175f5344d836 req-a2f04e0a-f6f9-435c-9814-18a1e160c242 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032392 Jul 20 15:47:02.870496 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 586/1174] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 15:47:03.367440 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 15:47:03.367762 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Wed Jul 20 15:47:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 15:47:26.675695 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 15:47:26.676339 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Wed Jul 20 15:47:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 15:48:32.102081 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 15:48:32.102699 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Wed Jul 20 15:48:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 15:48:32.264756 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_api:SELECT=30 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:48:32.264756 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG dbcounter [-] [124711] Writing DB stats nova_cell1:SELECT=58 {{(pid=124711) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:48:32.272011 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-45611f5c-50d0-44e8-9001-754b0faf500d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:48:32.272588 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-45611f5c-50d0-44e8-9001-754b0faf500d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:48:32.275375 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:48:32.275785 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG dbcounter [-] [124712] Writing DB stats nova_cell1:SELECT=58 {{(pid=124712) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 15:48:32.281031 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-45611f5c-50d0-44e8-9001-754b0faf500d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:32.281559 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-45611f5c-50d0-44e8-9001-754b0faf500d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:32.282367 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-45611f5c-50d0-44e8-9001-754b0faf500d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:32.282809 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-45611f5c-50d0-44e8-9001-754b0faf500d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:32.313258 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-45611f5c-50d0-44e8-9001-754b0faf500d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Going to try to terminate instance {{(pid=124712) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 15:48:32.351082 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-2b8d9313-09cc-4e92-a2ca-ca13df02dce1 req-98bcbb35-6b18-4cfe-88ea-ee826a081d55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66c75339-7bf0-44d2-bfd6-9423a5bee629", "tag": "694cd4a5-edf0-4c30-8149-2d9993368cc5"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:48:32.361838 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-2b8d9313-09cc-4e92-a2ca-ca13df02dce1 req-98bcbb35-6b18-4cfe-88ea-ee826a081d55 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:32.367563 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-2b8d9313-09cc-4e92-a2ca-ca13df02dce1 req-98bcbb35-6b18-4cfe-88ea-ee826a081d55 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:32.379113 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-2b8d9313-09cc-4e92-a2ca-ca13df02dce1 req-98bcbb35-6b18-4cfe-88ea-ee826a081d55 service nova] Creating event network-changed:694cd4a5-edf0-4c30-8149-2d9993368cc5 for instance 66c75339-7bf0-44d2-bfd6-9423a5bee629 on hv-cinder-81914 Jul 20 15:48:32.385260 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-2b8d9313-09cc-4e92-a2ca-ca13df02dce1 req-98bcbb35-6b18-4cfe-88ea-ee826a081d55 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123834 Jul 20 15:48:32.386610 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 587/1175] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:48:33.386542 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-45611f5c-50d0-44e8-9001-754b0faf500d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "DELETE /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 204 len: 0 microversion: 2.1 time: 1.127825 Jul 20 15:48:33.388006 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 589/1176] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:48:32 2022] DELETE /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 0 bytes in 1130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 15:48:33.397086 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-3e2aaa19-d028-4ad7-9ce4-91773221b839 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:48:33.398572 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-3e2aaa19-d028-4ad7-9ce4-91773221b839 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:48:33.406880 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3e2aaa19-d028-4ad7-9ce4-91773221b839 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:33.414241 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3e2aaa19-d028-4ad7-9ce4-91773221b839 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:33.414241 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3e2aaa19-d028-4ad7-9ce4-91773221b839 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:33.414241 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-3e2aaa19-d028-4ad7-9ce4-91773221b839 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:33.554290 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-3e2aaa19-d028-4ad7-9ce4-91773221b839 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:48:33.562814 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-3e2aaa19-d028-4ad7-9ce4-91773221b839 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1460 microversion: 2.1 time: 0.170826 Jul 20 15:48:33.563376 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 588/1177] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:48:33 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1460 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:48:34.581916 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-4e7c1bdc-23fd-430d-8bd8-4b83f23ab90c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:48:34.582642 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-4e7c1bdc-23fd-430d-8bd8-4b83f23ab90c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:48:34.589828 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4e7c1bdc-23fd-430d-8bd8-4b83f23ab90c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:34.590287 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4e7c1bdc-23fd-430d-8bd8-4b83f23ab90c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:34.591071 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4e7c1bdc-23fd-430d-8bd8-4b83f23ab90c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:34.592167 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4e7c1bdc-23fd-430d-8bd8-4b83f23ab90c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:34.735082 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-4e7c1bdc-23fd-430d-8bd8-4b83f23ab90c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:48:34.742770 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-4e7c1bdc-23fd-430d-8bd8-4b83f23ab90c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1460 microversion: 2.1 time: 0.165174 Jul 20 15:48:34.743332 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 590/1178] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:48:34 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1460 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:48:35.589411 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [req-1fca1984-1c79-4b24-aae5-52ed21f60e0a req-803b5989-d0a4-4b05-9460-399d733dc0a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66c75339-7bf0-44d2-bfd6-9423a5bee629", "name": "network-vif-deleted", "tag": "694cd4a5-edf0-4c30-8149-2d9993368cc5"}]} {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:48:35.589411 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-1fca1984-1c79-4b24-aae5-52ed21f60e0a req-803b5989-d0a4-4b05-9460-399d733dc0a3 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:35.589411 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [req-1fca1984-1c79-4b24-aae5-52ed21f60e0a req-803b5989-d0a4-4b05-9460-399d733dc0a3 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:35.595440 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.compute.server_external_events [req-1fca1984-1c79-4b24-aae5-52ed21f60e0a req-803b5989-d0a4-4b05-9460-399d733dc0a3 service nova] Creating event network-vif-deleted:694cd4a5-edf0-4c30-8149-2d9993368cc5 for instance 66c75339-7bf0-44d2-bfd6-9423a5bee629 on hv-cinder-81914 Jul 20 15:48:35.600291 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [req-1fca1984-1c79-4b24-aae5-52ed21f60e0a req-803b5989-d0a4-4b05-9460-399d733dc0a3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089636 Jul 20 15:48:35.600869 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 589/1179] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:48:35.761928 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-8c746fca-c3ba-4582-9494-b83597b58e4c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:48:35.762681 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-8c746fca-c3ba-4582-9494-b83597b58e4c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:48:35.768805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8c746fca-c3ba-4582-9494-b83597b58e4c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:35.780646 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8c746fca-c3ba-4582-9494-b83597b58e4c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:35.780646 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8c746fca-c3ba-4582-9494-b83597b58e4c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:35.780646 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-8c746fca-c3ba-4582-9494-b83597b58e4c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:35.845754 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-8c746fca-c3ba-4582-9494-b83597b58e4c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:48:35.854881 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-8c746fca-c3ba-4582-9494-b83597b58e4c tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1393 microversion: 2.1 time: 0.098198 Jul 20 15:48:35.855632 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 591/1180] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:48:35 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1393 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:48:36.876759 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-786c2277-0102-4f47-8f01-65d1495bf146 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:48:36.877573 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-786c2277-0102-4f47-8f01-65d1495bf146 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:48:36.884242 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-786c2277-0102-4f47-8f01-65d1495bf146 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:36.920097 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-786c2277-0102-4f47-8f01-65d1495bf146 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:36.920097 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-786c2277-0102-4f47-8f01-65d1495bf146 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:36.920097 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-786c2277-0102-4f47-8f01-65d1495bf146 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:36.927620 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-786c2277-0102-4f47-8f01-65d1495bf146 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:36.928142 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-786c2277-0102-4f47-8f01-65d1495bf146 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:36.928654 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.objects.instance [None req-786c2277-0102-4f47-8f01-65d1495bf146 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lazy-loading 'fault' on Instance uuid 66c75339-7bf0-44d2-bfd6-9423a5bee629 {{(pid=124711) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 15:48:36.975320 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-786c2277-0102-4f47-8f01-65d1495bf146 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:48:36.984256 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-786c2277-0102-4f47-8f01-65d1495bf146 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 200 len: 1231 microversion: 2.1 time: 0.115052 Jul 20 15:48:36.984895 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 590/1181] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:48:36 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 1231 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:48:38.001399 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e5ae0bea-7ff2-4b2e-8626-2493777bfb4f tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:48:38.002102 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-e5ae0bea-7ff2-4b2e-8626-2493777bfb4f tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 66c75339-7bf0-44d2-bfd6-9423a5bee629] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:48:38.009205 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e5ae0bea-7ff2-4b2e-8626-2493777bfb4f tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:38.009832 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e5ae0bea-7ff2-4b2e-8626-2493777bfb4f tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:38.011401 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e5ae0bea-7ff2-4b2e-8626-2493777bfb4f tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:38.012080 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-e5ae0bea-7ff2-4b2e-8626-2493777bfb4f tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:38.027482 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-e5ae0bea-7ff2-4b2e-8626-2493777bfb4f tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] HTTP exception thrown: Instance 66c75339-7bf0-44d2-bfd6-9423a5bee629 could not be found. Jul 20 15:48:38.029149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e5ae0bea-7ff2-4b2e-8626-2493777bfb4f tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Request method failure captured: Jul 20 15:48:38.029149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 HTTP/1.1 Jul 20 15:48:38.029149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:48:38.029149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:48:38.029149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:48:38.029149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:48:38.029149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:48:38.029149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:48:38.029149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:48:38.029149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:48:38.029149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2CIqB4z9r5hIY3uyG1t3ZhjRQftGwjcoDL2F9ce-WcSFLq28VkW2hwb8TfRxyqsmke9qALowC5OnsmA-BBjM6-QS9JAPLWdSOTh2zmP3315w7k7fV6aqLiEvqIfKNj-MO81pjG5BUtYSTP7ys-ugLW57tgf4K5S8HluxOkrwKAU6A4M Jul 20 15:48:38.029149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:48:38.029149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:48:38.029149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:48:38.029149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:48:38.029149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:48:38.029149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:48:38.029149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 68372ee91fb843108d3b0cb1c99cd186 Jul 20 15:48:38.029149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-TestVolumeBootPattern-884236090 Jul 20 15:48:38.029149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:48:38.029149 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:48:38.031057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/68372ee91fb843108d3b0cb1c99cd186"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/68372ee91fb843108d3b0cb1c99cd186"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_68372ee91fb843108d3b0cb1c99cd186", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/68372ee91fb843108d3b0cb1c99cd186"}]}] Jul 20 15:48:38.031057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-TestVolumeBootPattern-884236090 Jul 20 15:48:38.031057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 68372ee91fb843108d3b0cb1c99cd186 Jul 20 15:48:38.031057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-TestVolumeBootPattern-884236090 Jul 20 15:48:38.031057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-TestVolumeBootPattern-884236090-project Jul 20 15:48:38.031057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:48:38.031057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:48:38.031057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: cb4dc884b7eb4aa8a0adcdb46c5f9586 Jul 20 15:48:38.031057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-TestVolumeBootPattern-884236090-project Jul 20 15:48:38.031057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:48:38.031057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance 66c75339-7bf0-44d2-bfd6-9423a5bee629 could not be found. Jul 20 15:48:38.031057 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': '66c75339-7bf0-44d2-bfd6-9423a5bee629'} Jul 20 15:48:38.032143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:48:38.032143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:48:38.032143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:48:38.032143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:48:38.032143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:48:38.032143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:48:38.032143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:48:38.032143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:48:38.032143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:48:38.032143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:48:38.032143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66c75339-7bf0-44d2-bfd6-9423a5bee629 could not be found. Jul 20 15:48:38.032143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:48:38.032143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:48:38.032143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:48:38.032143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:48:38.032143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:48:38.032143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:48:38.032143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:48:38.032143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:48:38.032143 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:48:38.033922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:48:38.033922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:48:38.033922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:48:38.033922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:48:38.033922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:48:38.033922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:48:38.033922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:48:38.033922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66c75339-7bf0-44d2-bfd6-9423a5bee629 could not be found. Jul 20 15:48:38.033922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:48:38.033922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:48:38.033922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:48:38.033922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:48:38.033922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:48:38.033922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:48:38.033922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:48:38.033922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:48:38.033922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66c75339-7bf0-44d2-bfd6-9423a5bee629 could not be found. Jul 20 15:48:38.033922 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:48:38.035621 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-e5ae0bea-7ff2-4b2e-8626-2493777bfb4f tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Returning 404 to user: Instance 66c75339-7bf0-44d2-bfd6-9423a5bee629 could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:48:38.035621 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-e5ae0bea-7ff2-4b2e-8626-2493777bfb4f tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629" status: 404 len: 111 microversion: 2.1 time: 0.033124 Jul 20 15:48:38.035621 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 592/1182] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:48:37 2022] GET /compute/v2.1/servers/66c75339-7bf0-44d2-bfd6-9423a5bee629 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:48:41.613374 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-7cc73b0b-fcb8-46a5-9ca8-551294a8b906 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:48:41.614446 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-24fc6445-00a7-464b-9508-82a419a3096e req-da2c0887-b072-4535-b902-4445d531497b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd6f927d-f118-4346-b787-006374e56107", "tag": "79406cc4-e652-4f2a-9034-e4eee6709cd7"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:48:41.614863 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-7cc73b0b-fcb8-46a5-9ca8-551294a8b906 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: cd6f927d-f118-4346-b787-006374e56107] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:48:41.626832 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7cc73b0b-fcb8-46a5-9ca8-551294a8b906 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:41.627679 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7cc73b0b-fcb8-46a5-9ca8-551294a8b906 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:41.629039 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7cc73b0b-fcb8-46a5-9ca8-551294a8b906 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:41.629339 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-24fc6445-00a7-464b-9508-82a419a3096e req-da2c0887-b072-4535-b902-4445d531497b service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:41.629931 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-7cc73b0b-fcb8-46a5-9ca8-551294a8b906 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:41.630421 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-24fc6445-00a7-464b-9508-82a419a3096e req-da2c0887-b072-4535-b902-4445d531497b service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:41.651131 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-24fc6445-00a7-464b-9508-82a419a3096e req-da2c0887-b072-4535-b902-4445d531497b service nova] Creating event network-changed:79406cc4-e652-4f2a-9034-e4eee6709cd7 for instance cd6f927d-f118-4346-b787-006374e56107 on hv-cinder-81914 Jul 20 15:48:41.659606 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-24fc6445-00a7-464b-9508-82a419a3096e req-da2c0887-b072-4535-b902-4445d531497b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050924 Jul 20 15:48:41.660571 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 593/1183] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:48:41.673781 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-7cc73b0b-fcb8-46a5-9ca8-551294a8b906 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: cd6f927d-f118-4346-b787-006374e56107] Going to try to terminate instance {{(pid=124711) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 15:48:42.112806 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-7cc73b0b-fcb8-46a5-9ca8-551294a8b906 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "DELETE /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107" status: 204 len: 0 microversion: 2.1 time: 0.505955 Jul 20 15:48:42.114006 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 591/1184] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:48:41 2022] DELETE /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 15:48:42.122733 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-7a9eb921-f46f-4129-a0ce-66e3916e92c7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:48:42.123464 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-7a9eb921-f46f-4129-a0ce-66e3916e92c7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: cd6f927d-f118-4346-b787-006374e56107] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:48:42.131502 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7a9eb921-f46f-4129-a0ce-66e3916e92c7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:42.145531 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7a9eb921-f46f-4129-a0ce-66e3916e92c7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:42.145531 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7a9eb921-f46f-4129-a0ce-66e3916e92c7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:42.145531 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-7a9eb921-f46f-4129-a0ce-66e3916e92c7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:42.275661 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.policy [None req-7a9eb921-f46f-4129-a0ce-66e3916e92c7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124712) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:48:42.284027 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-7a9eb921-f46f-4129-a0ce-66e3916e92c7 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107" status: 200 len: 1578 microversion: 2.1 time: 0.165629 Jul 20 15:48:42.284522 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 594/1185] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:48:42 2022] GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107 => generated 1578 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:48:43.305302 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-5af0c373-2114-49df-ab27-b9bea930b8c8 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:48:43.306030 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-5af0c373-2114-49df-ab27-b9bea930b8c8 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: cd6f927d-f118-4346-b787-006374e56107] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:48:43.313920 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5af0c373-2114-49df-ab27-b9bea930b8c8 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:43.314662 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5af0c373-2114-49df-ab27-b9bea930b8c8 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:43.315436 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5af0c373-2114-49df-ab27-b9bea930b8c8 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:43.315870 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-5af0c373-2114-49df-ab27-b9bea930b8c8 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:43.464662 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-5af0c373-2114-49df-ab27-b9bea930b8c8 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:48:43.472871 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-5af0c373-2114-49df-ab27-b9bea930b8c8 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107" status: 200 len: 1578 microversion: 2.1 time: 0.171832 Jul 20 15:48:43.473461 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 592/1186] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:48:43 2022] GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107 => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:48:44.120962 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [req-44735315-5c4a-4ca0-808b-33e74c7a9ed8 req-eb2c8ffe-7158-4b04-a9be-54f279c5d495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd6f927d-f118-4346-b787-006374e56107", "name": "network-vif-deleted", "tag": "79406cc4-e652-4f2a-9034-e4eee6709cd7"}]} {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 15:48:44.129646 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-44735315-5c4a-4ca0-808b-33e74c7a9ed8 req-eb2c8ffe-7158-4b04-a9be-54f279c5d495 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:44.132629 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [req-44735315-5c4a-4ca0-808b-33e74c7a9ed8 req-eb2c8ffe-7158-4b04-a9be-54f279c5d495 service nova] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:44.141718 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.compute.server_external_events [req-44735315-5c4a-4ca0-808b-33e74c7a9ed8 req-eb2c8ffe-7158-4b04-a9be-54f279c5d495 service nova] Creating event network-vif-deleted:79406cc4-e652-4f2a-9034-e4eee6709cd7 for instance cd6f927d-f118-4346-b787-006374e56107 on hv-cinder-81914 Jul 20 15:48:44.146893 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [req-44735315-5c4a-4ca0-808b-33e74c7a9ed8 req-eb2c8ffe-7158-4b04-a9be-54f279c5d495 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029699 Jul 20 15:48:44.147736 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 595/1187] 10.222.0.78 () {64 vars in 1317 bytes} [Wed Jul 20 15:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 15:48:44.493823 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-c3c491c4-52fb-42c4-b647-b53b12a2d00e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:48:44.496539 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-c3c491c4-52fb-42c4-b647-b53b12a2d00e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: cd6f927d-f118-4346-b787-006374e56107] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:48:44.504629 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c3c491c4-52fb-42c4-b647-b53b12a2d00e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:44.505105 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c3c491c4-52fb-42c4-b647-b53b12a2d00e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:44.506225 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c3c491c4-52fb-42c4-b647-b53b12a2d00e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:44.506837 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-c3c491c4-52fb-42c4-b647-b53b12a2d00e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:44.587192 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.policy [None req-c3c491c4-52fb-42c4-b647-b53b12a2d00e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cb4dc884b7eb4aa8a0adcdb46c5f9586', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68372ee91fb843108d3b0cb1c99cd186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124711) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 15:48:44.595295 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-c3c491c4-52fb-42c4-b647-b53b12a2d00e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107" status: 200 len: 1225 microversion: 2.1 time: 0.108460 Jul 20 15:48:44.595863 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 593/1188] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:48:44 2022] GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107 => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 15:48:45.613638 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-4db54a1b-e3f9-47fb-a150-1389f9b1ebf2 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:48:45.614341 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-4db54a1b-e3f9-47fb-a150-1389f9b1ebf2 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: cd6f927d-f118-4346-b787-006374e56107] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:48:45.621293 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4db54a1b-e3f9-47fb-a150-1389f9b1ebf2 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:45.622714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4db54a1b-e3f9-47fb-a150-1389f9b1ebf2 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:45.622714 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4db54a1b-e3f9-47fb-a150-1389f9b1ebf2 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:45.623079 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-4db54a1b-e3f9-47fb-a150-1389f9b1ebf2 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:45.636793 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-4db54a1b-e3f9-47fb-a150-1389f9b1ebf2 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] HTTP exception thrown: Instance cd6f927d-f118-4346-b787-006374e56107 could not be found. Jul 20 15:48:45.638440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-4db54a1b-e3f9-47fb-a150-1389f9b1ebf2 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Request method failure captured: Jul 20 15:48:45.638440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107 HTTP/1.1 Jul 20 15:48:45.638440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:48:45.638440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:48:45.638440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:48:45.638440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:48:45.638440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:48:45.638440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:48:45.638440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:48:45.638440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:48:45.638440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2CIqB4z9r5hIY3uyG1t3ZhjRQftGwjcoDL2F9ce-WcSFLq28VkW2hwb8TfRxyqsmke9qALowC5OnsmA-BBjM6-QS9JAPLWdSOTh2zmP3315w7k7fV6aqLiEvqIfKNj-MO81pjG5BUtYSTP7ys-ugLW57tgf4K5S8HluxOkrwKAU6A4M Jul 20 15:48:45.638440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:48:45.638440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:48:45.638440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:48:45.638440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:48:45.638440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:48:45.638440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:48:45.638440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 68372ee91fb843108d3b0cb1c99cd186 Jul 20 15:48:45.638440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-TestVolumeBootPattern-884236090 Jul 20 15:48:45.638440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:48:45.638440 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:48:45.640668 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/68372ee91fb843108d3b0cb1c99cd186"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/68372ee91fb843108d3b0cb1c99cd186"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_68372ee91fb843108d3b0cb1c99cd186", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/68372ee91fb843108d3b0cb1c99cd186"}]}] Jul 20 15:48:45.640668 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-TestVolumeBootPattern-884236090 Jul 20 15:48:45.640668 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 68372ee91fb843108d3b0cb1c99cd186 Jul 20 15:48:45.640668 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-TestVolumeBootPattern-884236090 Jul 20 15:48:45.640668 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-TestVolumeBootPattern-884236090-project Jul 20 15:48:45.640668 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:48:45.640668 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:48:45.640668 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: cb4dc884b7eb4aa8a0adcdb46c5f9586 Jul 20 15:48:45.640668 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-TestVolumeBootPattern-884236090-project Jul 20 15:48:45.640668 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:48:45.640668 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance cd6f927d-f118-4346-b787-006374e56107 could not be found. Jul 20 15:48:45.640668 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': 'cd6f927d-f118-4346-b787-006374e56107'} Jul 20 15:48:45.641604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:48:45.641604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:48:45.641604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:48:45.641604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:48:45.641604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:48:45.641604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:48:45.641604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:48:45.641604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:48:45.641604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:48:45.641604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:48:45.641604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd6f927d-f118-4346-b787-006374e56107 could not be found. Jul 20 15:48:45.641604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:48:45.641604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:48:45.641604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:48:45.641604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:48:45.641604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:48:45.641604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:48:45.641604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:48:45.641604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:48:45.641604 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:48:45.643366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:48:45.643366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:48:45.643366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:48:45.643366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:48:45.643366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:48:45.643366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:48:45.643366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:48:45.643366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd6f927d-f118-4346-b787-006374e56107 could not be found. Jul 20 15:48:45.643366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:48:45.643366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:48:45.643366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:48:45.643366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:48:45.643366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:48:45.643366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:48:45.643366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:48:45.643366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:48:45.643366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd6f927d-f118-4346-b787-006374e56107 could not be found. Jul 20 15:48:45.643366 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:48:45.645319 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-4db54a1b-e3f9-47fb-a150-1389f9b1ebf2 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Returning 404 to user: Instance cd6f927d-f118-4346-b787-006374e56107 could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:48:45.645319 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-4db54a1b-e3f9-47fb-a150-1389f9b1ebf2 tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107" status: 404 len: 111 microversion: 2.1 time: 0.030671 Jul 20 15:48:45.645319 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 596/1189] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:48:45 2022] GET /compute/v2.1/servers/cd6f927d-f118-4346-b787-006374e56107 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:48:46.479615 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-dab8c882-83e3-4836-9986-35213256796e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:48:46.480188 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.compute.api [None req-dab8c882-83e3-4836-9986-35213256796e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124711) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:48:46.487371 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dab8c882-83e3-4836-9986-35213256796e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:46.487881 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dab8c882-83e3-4836-9986-35213256796e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:46.488734 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dab8c882-83e3-4836-9986-35213256796e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:46.489206 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG oslo_concurrency.lockutils [None req-dab8c882-83e3-4836-9986-35213256796e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124711) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:46.503697 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.wsgi [None req-dab8c882-83e3-4836-9986-35213256796e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] HTTP exception thrown: Instance 8dd5710a-4106-4dcd-8ec4-083d49813b41 could not be found. Jul 20 15:48:46.505365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-dab8c882-83e3-4836-9986-35213256796e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Request method failure captured: Jul 20 15:48:46.505365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: request: DELETE /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 HTTP/1.1 Jul 20 15:48:46.505365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept: application/json Jul 20 15:48:46.505365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Accept-Encoding: identity Jul 20 15:48:46.505365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Connection: close Jul 20 15:48:46.505365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Length: 0 Jul 20 15:48:46.505365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Content-Type: application/json Jul 20 15:48:46.505365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Host: 10.222.0.78 Jul 20 15:48:46.505365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Openstack-System-Scope: None Jul 20 15:48:46.505365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: User-Agent: python-urllib3/1.26.9 Jul 20 15:48:46.505365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Auth-Token: gAAAAABi2CIqB4z9r5hIY3uyG1t3ZhjRQftGwjcoDL2F9ce-WcSFLq28VkW2hwb8TfRxyqsmke9qALowC5OnsmA-BBjM6-QS9JAPLWdSOTh2zmP3315w7k7fV6aqLiEvqIfKNj-MO81pjG5BUtYSTP7ys-ugLW57tgf4K5S8HluxOkrwKAU6A4M Jul 20 15:48:46.505365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Id: None Jul 20 15:48:46.505365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Domain-Name: None Jul 20 15:48:46.505365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Identity-Status: Confirmed Jul 20 15:48:46.505365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Is-Admin-Project: True Jul 20 15:48:46.505365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Id: default Jul 20 15:48:46.505365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Domain-Name: Default Jul 20 15:48:46.505365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Id: 68372ee91fb843108d3b0cb1c99cd186 Jul 20 15:48:46.505365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Project-Name: tempest-TestVolumeBootPattern-884236090 Jul 20 15:48:46.505365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Role: member,reader Jul 20 15:48:46.505365 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Roles: member,reader Jul 20 15:48:46.507174 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/68372ee91fb843108d3b0cb1c99cd186"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/68372ee91fb843108d3b0cb1c99cd186"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_68372ee91fb843108d3b0cb1c99cd186", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/68372ee91fb843108d3b0cb1c99cd186"}]}] Jul 20 15:48:46.507174 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant: tempest-TestVolumeBootPattern-884236090 Jul 20 15:48:46.507174 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Id: 68372ee91fb843108d3b0cb1c99cd186 Jul 20 15:48:46.507174 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-Tenant-Name: tempest-TestVolumeBootPattern-884236090 Jul 20 15:48:46.507174 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User: tempest-TestVolumeBootPattern-884236090-project Jul 20 15:48:46.507174 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Id: default Jul 20 15:48:46.507174 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Domain-Name: Default Jul 20 15:48:46.507174 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Id: cb4dc884b7eb4aa8a0adcdb46c5f9586 Jul 20 15:48:46.507174 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: X-User-Name: tempest-TestVolumeBootPattern-884236090-project Jul 20 15:48:46.507174 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: method: > Jul 20 15:48:46.507174 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: exception: Instance 8dd5710a-4106-4dcd-8ec4-083d49813b41 could not be found. Jul 20 15:48:46.507174 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: action_args: {'id': '8dd5710a-4106-4dcd-8ec4-083d49813b41'} Jul 20 15:48:46.508204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:48:46.508204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:48:46.508204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:48:46.508204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:48:46.508204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:48:46.508204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:48:46.508204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:48:46.508204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:48:46.508204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:48:46.508204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:48:46.508204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dd5710a-4106-4dcd-8ec4-083d49813b41 could not be found. Jul 20 15:48:46.508204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:48:46.508204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:48:46.508204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:48:46.508204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:48:46.508204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:48:46.508204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:48:46.508204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:48:46.508204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:48:46.508204 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:48:46.509607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:48:46.509607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 15:48:46.509607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 15:48:46.509607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 15:48:46.509607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 15:48:46.509607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:48:46.509607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:48:46.509607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:48:46.509607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:48:46.509607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dd5710a-4106-4dcd-8ec4-083d49813b41 could not be found. Jul 20 15:48:46.509607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:48:46.509607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:48:46.509607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:48:46.509607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:48:46.509607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:48:46.509607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:48:46.509607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:48:46.509607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:48:46.509607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dd5710a-4106-4dcd-8ec4-083d49813b41 could not be found. Jul 20 15:48:46.509607 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: ERROR nova.api.openstack.wsgi Jul 20 15:48:46.511977 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-dab8c882-83e3-4836-9986-35213256796e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Returning 404 to user: Instance 8dd5710a-4106-4dcd-8ec4-083d49813b41 could not be found. {{(pid=124711) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:48:46.511977 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-dab8c882-83e3-4836-9986-35213256796e tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 404 len: 111 microversion: 2.1 time: 0.033637 Jul 20 15:48:46.511977 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 594/1190] 10.222.0.78 () {58 vars in 1238 bytes} [Wed Jul 20 15:48:46 2022] DELETE /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:48:46.516132 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-f6ee2856-7140-4cc0-b72f-ff7717938d5d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '>' {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:48:46.516742 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.compute.api [None req-f6ee2856-7140-4cc0-b72f-ff7717938d5d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] [instance: 8dd5710a-4106-4dcd-8ec4-083d49813b41] Fetching instance by UUID {{(pid=124712) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 15:48:46.522866 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f6ee2856-7140-4cc0-b72f-ff7717938d5d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:46.523308 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f6ee2856-7140-4cc0-b72f-ff7717938d5d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:46.524070 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f6ee2856-7140-4cc0-b72f-ff7717938d5d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 15:48:46.524501 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG oslo_concurrency.lockutils [None req-f6ee2856-7140-4cc0-b72f-ff7717938d5d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Lock "794b77f4-e750-4ef6-ba0b-862dc242f7fe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124712) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 15:48:46.538419 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.wsgi [None req-f6ee2856-7140-4cc0-b72f-ff7717938d5d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] HTTP exception thrown: Instance 8dd5710a-4106-4dcd-8ec4-083d49813b41 could not be found. Jul 20 15:48:46.539948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-f6ee2856-7140-4cc0-b72f-ff7717938d5d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Request method failure captured: Jul 20 15:48:46.539948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: request: GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 HTTP/1.1 Jul 20 15:48:46.539948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept: application/json Jul 20 15:48:46.539948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Accept-Encoding: identity Jul 20 15:48:46.539948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Connection: close Jul 20 15:48:46.539948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Length: 0 Jul 20 15:48:46.539948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Content-Type: application/json Jul 20 15:48:46.539948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Host: 10.222.0.78 Jul 20 15:48:46.539948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Openstack-System-Scope: None Jul 20 15:48:46.539948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: User-Agent: python-urllib3/1.26.9 Jul 20 15:48:46.539948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Auth-Token: gAAAAABi2CIqB4z9r5hIY3uyG1t3ZhjRQftGwjcoDL2F9ce-WcSFLq28VkW2hwb8TfRxyqsmke9qALowC5OnsmA-BBjM6-QS9JAPLWdSOTh2zmP3315w7k7fV6aqLiEvqIfKNj-MO81pjG5BUtYSTP7ys-ugLW57tgf4K5S8HluxOkrwKAU6A4M Jul 20 15:48:46.539948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Id: None Jul 20 15:48:46.539948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Domain-Name: None Jul 20 15:48:46.539948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Identity-Status: Confirmed Jul 20 15:48:46.539948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Is-Admin-Project: True Jul 20 15:48:46.539948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Id: default Jul 20 15:48:46.539948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Domain-Name: Default Jul 20 15:48:46.539948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Id: 68372ee91fb843108d3b0cb1c99cd186 Jul 20 15:48:46.539948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Project-Name: tempest-TestVolumeBootPattern-884236090 Jul 20 15:48:46.539948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Role: member,reader Jul 20 15:48:46.539948 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Roles: member,reader Jul 20 15:48:46.542160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/68372ee91fb843108d3b0cb1c99cd186"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/68372ee91fb843108d3b0cb1c99cd186"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_68372ee91fb843108d3b0cb1c99cd186", "adminURL": "http://10.222.0.78:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/68372ee91fb843108d3b0cb1c99cd186"}]}] Jul 20 15:48:46.542160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant: tempest-TestVolumeBootPattern-884236090 Jul 20 15:48:46.542160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Id: 68372ee91fb843108d3b0cb1c99cd186 Jul 20 15:48:46.542160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-Tenant-Name: tempest-TestVolumeBootPattern-884236090 Jul 20 15:48:46.542160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User: tempest-TestVolumeBootPattern-884236090-project Jul 20 15:48:46.542160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Id: default Jul 20 15:48:46.542160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Domain-Name: Default Jul 20 15:48:46.542160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Id: cb4dc884b7eb4aa8a0adcdb46c5f9586 Jul 20 15:48:46.542160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: X-User-Name: tempest-TestVolumeBootPattern-884236090-project Jul 20 15:48:46.542160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: method: > Jul 20 15:48:46.542160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: exception: Instance 8dd5710a-4106-4dcd-8ec4-083d49813b41 could not be found. Jul 20 15:48:46.542160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: action_args: {'id': '8dd5710a-4106-4dcd-8ec4-083d49813b41'} Jul 20 15:48:46.543243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: {{(pid=124712) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 15:48:46.543243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:48:46.543243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 15:48:46.543243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 15:48:46.543243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 15:48:46.543243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 15:48:46.543243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 15:48:46.543243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 15:48:46.543243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 15:48:46.543243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 15:48:46.543243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dd5710a-4106-4dcd-8ec4-083d49813b41 could not be found. Jul 20 15:48:46.543243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:48:46.543243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:48:46.543243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:48:46.543243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:48:46.543243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:48:46.543243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:48:46.543243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 15:48:46.543243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 15:48:46.543243 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 15:48:46.544805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 15:48:46.544805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 15:48:46.544805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 15:48:46.544805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 15:48:46.544805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 15:48:46.544805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 15:48:46.544805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 15:48:46.544805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dd5710a-4106-4dcd-8ec4-083d49813b41 could not be found. Jul 20 15:48:46.544805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:48:46.544805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 15:48:46.544805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:48:46.544805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 15:48:46.544805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 15:48:46.544805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 15:48:46.544805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 15:48:46.544805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 15:48:46.544805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dd5710a-4106-4dcd-8ec4-083d49813b41 could not be found. Jul 20 15:48:46.544805 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: ERROR nova.api.openstack.wsgi Jul 20 15:48:46.546546 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: DEBUG nova.api.openstack.wsgi [None req-f6ee2856-7140-4cc0-b72f-ff7717938d5d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Returning 404 to user: Instance 8dd5710a-4106-4dcd-8ec4-083d49813b41 could not be found. {{(pid=124712) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 15:48:46.546546 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO nova.api.openstack.requestlog [None req-f6ee2856-7140-4cc0-b72f-ff7717938d5d tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41" status: 404 len: 111 microversion: 2.1 time: 0.029082 Jul 20 15:48:46.546546 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: [pid: 124712|app: 0|req: 597/1191] 10.222.0.78 () {58 vars in 1235 bytes} [Wed Jul 20 15:48:46 2022] GET /compute/v2.1/servers/8dd5710a-4106-4dcd-8ec4-083d49813b41 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 15:48:48.096526 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: DEBUG nova.api.openstack.wsgi [None req-6d540a79-7763-4732-996f-68f8901e53ba tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] Calling method '.version_select at 0x7efd90d273a0>' {{(pid=124711) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 15:48:48.188119 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO nova.api.openstack.requestlog [None req-6d540a79-7763-4732-996f-68f8901e53ba tempest-TestVolumeBootPattern-884236090 tempest-TestVolumeBootPattern-884236090-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1520672230" status: 202 len: 0 microversion: 2.1 time: 0.095384 Jul 20 15:48:48.188692 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: [pid: 124711|app: 0|req: 595/1192] 10.222.0.78 () {58 vars in 1262 bytes} [Wed Jul 20 15:48:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1520672230 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 15:50:23.378544 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 15:50:23.379338 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Wed Jul 20 15:50:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 15:50:46.684492 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 15:50:46.685160 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Wed Jul 20 15:50:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 15:51:52.111566 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 15:51:52.112097 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Wed Jul 20 15:51:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 15:51:54.998319 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 15:51:54.998924 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Wed Jul 20 15:51:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 15:53:43.387963 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 15:53:43.388575 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Wed Jul 20 15:53:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 15:53:54.234745 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 15:53:54.235408 dv-cinder-819149-12-iscsi devstack@n-api.service[124711]: Wed Jul 20 15:53:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 15:53:56.849493 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 15:53:56.850150 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Wed Jul 20 15:53:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 15:54:06.693145 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 15:54:06.693816 dv-cinder-819149-12-iscsi devstack@n-api.service[124712]: Wed Jul 20 15:54:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!